-- Logs begin at Mon 2022-06-20 05:12:24 UTC, end at Mon 2022-06-20 06:33:03 UTC. -- Jun 20 06:02:24.444107 dv-cinder-804035-47-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:02:24.457065 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:02:24 2022] *** Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: nodename: dv-cinder-804035-47-iscsi Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: machine: x86_64 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: clock source: unix Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: pcre jit disabled Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: detected number of CPU cores: 4 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: current working directory: / Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: your processes number limit is 47680 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: your memory page size is 4096 bytes Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: detected max file descriptor number: 2048 Jun 20 06:02:24.459070 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: lock engine: pthread robust mutexes Jun 20 06:02:24.459992 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: thunder lock: enabled Jun 20 06:02:24.459992 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:02:24.459992 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:02:24.504311 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: Python main interpreter initialized at 0x55a5171409c0 Jun 20 06:02:24.504311 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: python threads support enabled Jun 20 06:02:24.504311 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: your server socket listen backlog is limited to 100 connections Jun 20 06:02:24.504311 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:02:24.504736 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:02:24.504736 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: *** Operational MODE: preforking *** Jun 20 06:02:24.505003 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:02:24.505003 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: spawned uWSGI master process (pid: 103212) Jun 20 06:02:24.505200 dv-cinder-804035-47-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:02:24.507285 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: spawned uWSGI worker 1 (pid: 103213, cores: 1) Jun 20 06:02:24.507285 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: spawned uWSGI worker 2 (pid: 103214, cores: 1) Jun 20 06:02:24.507285 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:02:25.181596 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:25.182224 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:02:26.316554 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:26.316554 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: from cryptography.utils import int_from_bytes Jun 20 06:02:26.317465 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:26.317465 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: from cryptography.utils import int_from_bytes Jun 20 06:02:26.322340 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:26.322340 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: from cryptography.utils import int_from_bytes Jun 20 06:02:26.322790 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:02:26.322790 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: from cryptography.utils import int_from_bytes Jun 20 06:02:28.834739 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:28.835267 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:28.835418 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:28.835777 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:28.836045 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:28.836414 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.836519 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:02:28.836934 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.837039 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:02:28.837134 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.837283 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:02:28.837433 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.837658 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:02:28.837757 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.837947 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:02:28.838058 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.838297 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.838390 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.838615 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.838720 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.838936 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839029 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839194 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839330 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839504 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839663 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839825 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-47-iscsi {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.839977 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840145 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840306 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840448 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840629 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840785 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.840983 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.841676 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.841833 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842052 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842147 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842460 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842563 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-47-iscsi {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842771 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.842864 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.843079 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.843275 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.843389 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.844450 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.844592 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.844742 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.844886 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.844886 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845119 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845119 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845617 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845770 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.845898 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846022 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846170 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846318 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846445 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846580 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846720 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846846 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.846989 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847109 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-47-iscsi {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847240 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847365 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847497 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847628 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847760 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.847893 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848009 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848139 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848278 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848419 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848551 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-47-iscsi {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848689 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.848858 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849004 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849136 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849321 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849446 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849629 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849845 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.849956 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850151 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850304 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850448 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850611 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850764 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.850907 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851080 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851230 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851393 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851536 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851745 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.851893 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852060 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852209 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852346 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852486 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852651 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852843 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.852988 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853125 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853277 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853432 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853568 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853698 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.853805 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854021 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854115 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854331 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854429 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854588 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854689 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854878 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.854970 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855190 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855286 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855493 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855580 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855820 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.855917 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856125 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856212 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856380 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856482 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856633 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.856884 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857098 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857273 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857496 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857591 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857803 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.857898 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858120 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858223 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858432 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858524 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858745 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.858846 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859049 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859149 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859359 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859462 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859673 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859766 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.859984 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860078 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860288 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860375 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860614 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860726 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.860952 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861046 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861255 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861343 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861571 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861660 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861888 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.861977 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862191 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862279 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862493 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862586 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862797 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.862893 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863110 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863197 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863427 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863521 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863725 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863819 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.863971 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864059 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864266 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864361 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864566 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864653 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.864934 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865043 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865218 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865316 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865520 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865608 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865821 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.865908 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866122 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866218 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866427 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866510 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866726 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.866811 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867028 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867122 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867329 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867415 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867629 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867721 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.867928 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868017 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868229 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868315 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868525 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868617 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868846 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.868937 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869153 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869246 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869461 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869554 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869758 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.869895 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870060 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870194 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870357 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870498 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870640 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870767 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.870956 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871084 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871254 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871390 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871554 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871684 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.871866 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.872005 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.872167 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.872933 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873066 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873193 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873327 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873608 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873743 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.873909 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874050 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874220 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874365 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874547 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874677 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874818 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.874953 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875124 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875255 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875426 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875563 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875727 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.875857 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876025 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876154 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876322 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876451 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876619 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876767 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.876946 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877076 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877243 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877374 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877543 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877680 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877839 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.877969 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878152 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878281 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878457 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878592 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878756 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.878890 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879057 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879198 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879356 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879490 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879657 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879791 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.879963 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.880105 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.880264 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.880392 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.880582 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.880738 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.880934 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.881085 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.881244 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.881373 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.881553 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.881683 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.881862 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.882004 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.882172 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.882300 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:02:28.882484 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.882620 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.882806 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.882936 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883277 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883404 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883600 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883740 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.883957 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.884087 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.884313 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.884452 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.884637 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.884922 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885053 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885178 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885303 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885429 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885572 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885708 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885859 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.885994 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886166 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886303 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886489 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886629 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886804 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.886933 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.887111 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.887270 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.887445 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.887634 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.887785 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.888647 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.888816 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889148 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889302 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889466 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889597 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889777 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.889908 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890086 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890229 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890396 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890534 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890721 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.890857 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891045 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891188 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891354 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891482 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891668 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891798 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.891977 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892108 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892284 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892426 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892591 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892747 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.892925 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893057 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893235 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893366 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893696 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.893875 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894006 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894189 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894328 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894499 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894628 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894812 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.894942 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895120 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895250 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895431 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895573 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.895864 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896038 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896175 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896338 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896476 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896640 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896793 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.896974 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897105 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897276 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897415 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897593 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897722 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.897909 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898212 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898349 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898523 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898660 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898829 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.898966 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899132 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899269 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899438 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899566 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899742 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.899882 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900041 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900170 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900348 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900476 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900658 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900809 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.900986 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901118 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901305 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901435 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901609 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901738 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.901912 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902042 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902232 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902362 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902534 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902671 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902834 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.902971 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903138 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903267 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903442 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903660 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903848 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.903977 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904109 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904235 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904390 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904531 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904720 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.904852 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905034 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905164 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905344 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905486 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905654 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905790 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.905960 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906098 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906274 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906411 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906584 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906714 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.906897 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907026 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907206 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907335 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907505 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907634 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907811 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.907940 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908131 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908266 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908392 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908525 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908682 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.908836 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909010 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909141 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909310 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909439 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909612 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909742 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.909912 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910045 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910214 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910344 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910516 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910655 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910832 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.910970 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911135 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911265 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911433 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911581 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911733 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.911870 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912032 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912173 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912506 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912668 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.912850 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913000 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913129 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913309 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913441 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913617 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913755 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.913940 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914165 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914343 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914470 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914596 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914722 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914847 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.914980 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915117 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915244 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915422 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915551 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915729 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.915858 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916045 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916186 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916351 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916666 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.916817 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917001 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917140 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917329 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917457 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917633 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917770 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.917947 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918074 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918246 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918374 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918556 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918694 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918867 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.918994 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.919347 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.919601 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.919601 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920010 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920140 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920266 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920392 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920530 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920656 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920837 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.920975 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921101 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921226 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921353 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921478 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921612 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921738 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921871 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.921997 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922123 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922299 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922432 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922613 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922752 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.922917 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923047 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923234 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923364 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923538 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923668 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923855 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.923984 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924156 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924286 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924465 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924595 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924809 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.924940 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925137 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925269 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925442 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925574 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925749 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.925888 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926056 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926184 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926358 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926488 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926664 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926807 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.926971 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927102 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927274 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927410 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927574 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927713 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.927879 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928016 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928188 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928317 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928494 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928633 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928822 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.928951 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929112 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929241 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929423 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929554 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929727 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.929857 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930029 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930159 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930328 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930458 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930632 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930760 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.930945 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931074 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931260 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931388 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931573 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.931885 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932014 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932185 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932313 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932486 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932616 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932816 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.932958 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933126 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933255 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933428 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933566 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933747 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.933883 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.934040 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.934176 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.934379 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.934516 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.934687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.935370 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.935626 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.935759 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.935894 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936030 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936165 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936332 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936471 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936722 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.936855 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937034 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937164 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937361 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937495 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937644 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937774 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.937975 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938115 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938281 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938412 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938588 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938718 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.938896 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.939296 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.939467 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.939596 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.939775 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.939904 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940095 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940238 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940407 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940548 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940730 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.940862 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941044 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941187 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941346 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941475 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941653 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941783 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.941965 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.942097 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.942292 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.942536 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.942675 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.942872 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943011 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943202 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943331 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943528 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943665 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943842 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.943980 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944156 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944294 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944470 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944600 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944796 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.944926 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945105 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945235 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945425 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945798 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.945995 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946137 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946333 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946463 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946654 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946784 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.946973 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947102 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947278 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947407 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947581 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947711 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.947892 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948022 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948193 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948331 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948495 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948626 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948833 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.948979 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949138 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949269 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949448 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949584 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949748 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.949888 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.950056 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.950186 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.950355 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951076 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951233 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951463 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951595 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951789 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.951923 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952109 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952239 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952406 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952536 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952756 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.952890 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953051 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953193 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953363 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953493 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953683 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953813 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.953994 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954301 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954429 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954601 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954731 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.954918 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955058 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955221 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955352 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955519 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955649 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955820 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.955960 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956126 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956254 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956427 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956563 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956748 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.956891 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957059 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957189 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957365 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957487 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957672 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957802 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.957979 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958117 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958279 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958417 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958583 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958715 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.958883 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959012 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959194 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959333 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959499 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959629 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959798 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.959928 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960098 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960238 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960410 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960540 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960741 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.960865 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961044 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961160 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961349 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961455 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961648 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961745 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.961957 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962256 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962389 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962559 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962738 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.962881 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963008 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963140 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963273 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963442 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963572 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963765 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.963898 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964058 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964186 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964363 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964491 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964662 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964847 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.964978 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965274 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965404 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965572 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965703 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.965871 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966000 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966214 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966349 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966485 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966707 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.966837 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967029 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967159 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967333 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967464 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967643 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967772 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.967944 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968081 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968247 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968378 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968547 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968678 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.968881 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969014 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969183 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969322 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969485 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969616 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969785 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.969923 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970084 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970213 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970382 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970513 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970700 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.970846 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971004 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971133 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971308 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971451 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971610 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971750 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.971911 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972040 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972220 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972348 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972525 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972664 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.972872 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973012 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973139 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973272 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973439 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973571 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973744 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.973876 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974067 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974197 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974378 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974485 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974683 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974788 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.974978 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975064 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975282 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975369 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975587 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975673 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975896 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.975984 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976195 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976284 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976495 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976582 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976835 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.976927 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977145 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977241 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977452 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977539 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977770 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.977888 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978086 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978181 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978387 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978473 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978694 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.978857 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979001 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979140 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979277 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979503 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979663 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979823 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.979971 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980122 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980261 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980399 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980536 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980683 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.980847 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.981024 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.981167 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.981317 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.981465 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.981604 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.982173 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.982360 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.982360 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.982648 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.982909 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983052 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983230 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983375 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983581 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983722 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.983870 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984132 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984277 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984416 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984566 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984770 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.984930 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985071 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985208 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985349 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985488 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985488 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985761 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.985899 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986183 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986183 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986472 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986613 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986752 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.986890 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987042 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987181 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987329 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987469 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987607 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987745 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.987884 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.988024 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.988229 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.988385 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.988575 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.988825 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.989089 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.989089 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.989551 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.989790 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990022 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990251 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990431 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990583 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990725 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.990863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991020 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991020 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991291 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991509 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991509 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991782 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991929 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.991929 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.992198 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.992345 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.992345 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.992613 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.992818 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.993114 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.993392 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.993624 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.993801 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.993943 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994094 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994243 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994397 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994537 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994677 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994817 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.994955 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995104 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995261 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995401 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995539 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995686 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.995851 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.996063 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.996322 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.996557 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.996825 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.997077 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.997891 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.998149 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.998407 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.998652 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.998903 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999136 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999526 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999667 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999807 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:28.999955 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000127 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000287 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000440 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000592 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000789 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.000944 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001086 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001226 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001226 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001487 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001635 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001635 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.001914 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002060 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002060 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002492 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002656 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002803 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.002942 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.003249 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.003494 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.003717 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.003956 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.004197 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.004434 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.004672 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.004972 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.005195 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.005423 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.005640 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.005853 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006003 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006152 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006295 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006434 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006574 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006713 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006850 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.006998 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007138 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007277 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007428 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007568 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007715 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007855 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.007993 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008132 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008270 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008411 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008558 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008757 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.008905 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009044 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009213 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009362 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009512 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009652 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009790 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.009928 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010075 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010222 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010373 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010514 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010661 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010807 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.010953 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011115 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011256 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011401 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011543 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011682 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011820 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.011967 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012122 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012261 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012400 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012539 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012678 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.012856 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.013626 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.013771 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.013911 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014050 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014050 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014505 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014657 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014806 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.014946 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015094 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015235 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015382 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015530 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015669 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015809 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.015959 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016100 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016239 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016392 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016532 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016671 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.016992 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017130 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017287 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017427 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017566 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017712 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017852 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.017990 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018129 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018285 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018434 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018574 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018723 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.018864 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019002 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019150 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019303 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019444 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019583 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019738 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.019891 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020032 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020188 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020338 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020478 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020642 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020845 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.020989 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021147 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021288 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021435 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021598 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021754 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.021909 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022050 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022198 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022338 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022520 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022667 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.022985 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023140 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023286 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023447 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023594 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023743 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.023882 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024046 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024169 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024354 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024446 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024662 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.024795 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025000 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025090 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025406 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025552 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025751 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.025876 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026096 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026186 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026430 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026527 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026746 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.026851 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027074 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027171 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027391 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027487 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027699 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.027791 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028008 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028097 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028318 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028434 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028666 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.028794 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029099 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029192 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029422 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029524 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029730 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.029816 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030053 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030142 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030365 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030454 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030676 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030764 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.030987 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.031230 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.031415 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.031569 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.031719 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.031864 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032225 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032377 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032520 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032675 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032849 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.032991 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.033129 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.033353 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.033505 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.033664 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.033884 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034040 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034191 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034191 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034463 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034609 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034749 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.034896 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035047 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035196 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035345 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035484 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035631 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035771 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.035926 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036066 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036212 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036359 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036505 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036662 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.036877 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037025 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037180 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037326 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037471 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037632 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037780 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.037780 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038057 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038211 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038357 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038517 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038664 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038810 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.038966 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039119 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039280 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039427 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039580 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039727 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.039873 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040017 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040175 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040353 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040505 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040658 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.040827 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041002 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041159 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041306 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041460 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041460 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041735 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.041889 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042036 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042189 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042336 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042481 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042625 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042789 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.042935 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043082 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043227 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043371 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043529 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043689 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043836 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.043981 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.044127 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.044497 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.044654 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.044839 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045000 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045147 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045299 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045446 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045600 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045747 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.045892 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046183 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046329 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046488 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046636 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046781 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.046937 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047082 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047227 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047382 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047528 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047673 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047818 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.047964 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048108 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048264 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048411 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048566 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048692 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.048848 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049025 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049172 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049475 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049562 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049778 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.049901 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050079 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050223 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050402 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050558 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050690 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.050928 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051029 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051277 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051577 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051675 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051883 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.051981 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.052182 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.052324 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.052493 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.052678 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.052826 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053046 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053135 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053384 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053472 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053696 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.053793 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054011 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054098 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054347 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054444 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054645 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054742 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.054944 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055032 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055254 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055343 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055560 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055656 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055876 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.055964 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056184 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056271 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056489 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056577 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056852 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.056943 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.057164 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.057270 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.057511 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.057691 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.057854 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058020 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058191 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058336 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058505 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058665 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058824 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.058991 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.059135 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.059294 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.059452 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.059597 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.059762 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.060425 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.060612 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061047 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061137 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061371 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061459 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061685 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061783 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.061993 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062105 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062303 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062420 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062612 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062732 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.062926 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063053 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063234 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063371 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063541 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063698 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.063848 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.064268 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.064407 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.064585 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.064730 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.064962 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065060 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065282 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065370 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065628 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065824 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.065963 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066168 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066279 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066499 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066585 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066843 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.066939 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067184 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067271 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067489 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067574 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067795 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.067883 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068101 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068188 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068408 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068494 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068742 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.068843 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069061 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069148 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069378 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069516 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069696 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.069827 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070012 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070243 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070335 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070554 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070642 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070871 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.070958 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071188 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071275 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071495 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071584 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071816 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.071914 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072127 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072212 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072431 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072519 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072769 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.072860 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073083 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073182 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073407 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073730 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.073823 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074050 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074146 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074368 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074451 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074670 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074765 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.074972 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.075068 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.075273 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.075359 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.076253 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.076352 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.076584 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.076679 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.076920 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077010 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077224 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077312 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077525 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077615 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077832 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.077987 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078132 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078308 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078433 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078633 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078720 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.078960 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079046 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079275 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079372 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079591 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079680 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079890 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.079978 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080190 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080278 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080488 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080576 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080819 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.080921 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081121 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081226 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081426 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081514 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081727 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.081829 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082030 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082136 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082414 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082625 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082721 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.082929 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083024 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083254 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083342 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083583 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083687 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083892 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.083987 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084209 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084303 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084514 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084604 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084892 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.084987 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085151 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085245 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085455 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085553 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085760 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.085848 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086066 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086155 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086373 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086471 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086674 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086759 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.086980 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087067 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087284 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087380 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087590 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087678 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087894 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.087980 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088198 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088293 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088504 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088590 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088832 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.088921 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089142 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089231 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089446 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089531 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089749 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.089848 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090053 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090142 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090453 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090680 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090774 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.090990 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.091097 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.091347 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.091436 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.091730 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.091830 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092054 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092168 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092368 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092466 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092683 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.092815 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093015 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093105 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093330 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093420 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093643 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093739 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.093966 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094059 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094286 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094374 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094594 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094691 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.094915 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095003 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095236 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095554 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095649 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095872 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.095961 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096205 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096301 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096526 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096612 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096860 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.096949 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.097169 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.097268 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.097474 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.097563 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.097714 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103214) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:29.097802 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.098116 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.098434 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.098767 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.099085 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.099402 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.099725 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.100042 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.100360 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.100681 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.101022 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.101353 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.101685 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.102001 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.102338 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.102666 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.103017 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.103334 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.103680 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.104012 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.104330 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.104648 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.104999 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:02:29.105245 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103213) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:02:29.160714 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO dbcounter [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Registered counter for database nova_api Jun 20 06:02:29.262148 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO dbcounter [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Registered counter for database nova_api Jun 20 06:02:29.272807 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_db.sqlalchemy.engines [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.279868 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writer thread running {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.283943 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.290408 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writer thread running {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.336539 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.context [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e28d6b1b-8395-40bc-a597-ebf7d975d5d1(cell1) {{(pid=103214) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:29.340439 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_concurrency.lockutils [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:29.342816 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_concurrency.lockutils [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:29.343601 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_concurrency.lockutils [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:29.345694 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_concurrency.lockutils [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103214) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:29.347794 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO dbcounter [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Registered counter for database nova_cell0 Jun 20 06:02:29.350529 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.context [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e28d6b1b-8395-40bc-a597-ebf7d975d5d1(cell1) {{(pid=103213) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:02:29.352027 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO dbcounter [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Registered counter for database nova_cell1 Jun 20 06:02:29.357457 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:29.359928 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_db.sqlalchemy.engines [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.360789 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:29.361222 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_db.sqlalchemy.engines [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.362179 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:02:29.364327 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:02:29.366402 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO dbcounter [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Registered counter for database nova_cell0 Jun 20 06:02:29.368739 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writer thread running {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.369199 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writer thread running {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.370670 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO dbcounter [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Registered counter for database nova_cell1 Jun 20 06:02:29.378725 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.379967 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.388847 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writer thread running {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.389191 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writer thread running {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.519238 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO dbcounter [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Registered counter for database nova_cell0 Jun 20 06:02:29.527891 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG oslo_db.sqlalchemy.engines [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103214) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.533213 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writer thread running {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.544368 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO dbcounter [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Registered counter for database nova_cell0 Jun 20 06:02:29.552880 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_db.sqlalchemy.engines [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103213) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:02:29.558508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writer thread running {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:02:29.880154 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: WARNING keystonemiddleware.auth_token [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:29.883053 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: WARNING keystonemiddleware.auth_token [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:29.887588 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: WARNING keystonemiddleware.auth_token [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:29.891442 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: WARNING keystonemiddleware.auth_token [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:30.234264 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: WARNING keystonemiddleware.auth_token [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:30.240295 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: WARNING keystonemiddleware.auth_token [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:30.243351 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: WARNING keystonemiddleware.auth_token [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:02:30.245643 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5171409c0 pid: 103213 (default app) Jun 20 06:02:30.247806 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:02:30.249136 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001898 Jun 20 06:02:30.249589 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Mon Jun 20 06:02:30 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:02:30.249812 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: WARNING keystonemiddleware.auth_token [None req-e33e8cca-7841-4edb-a8a4-4b201d27bc7b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:02:30.255054 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a5171409c0 pid: 103214 (default app) Jun 20 06:03:46.333769 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:46.336047 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003644 Jun 20 06:03:46.337240 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:46.363786 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_api:SELECT=3 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:46.366828 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_cell1:SELECT=3 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:46.368154 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_cell0:SELECT=3 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:46.369272 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:46.815107 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-12deb496-8ab0-472c-8cf5-0b11b26c5146 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:46.847785 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-12deb496-8ab0-472c-8cf5-0b11b26c5146 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502602 Jun 20 06:03:46.848603 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1291 bytes} [Mon Jun 20 06:03:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:48.941330 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:48.942247 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-d8e0a0aa-ff39-4eba-b1dc-6aaeff94d30e None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001511 Jun 20 06:03:48.945026 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:48 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:49.010970 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-c30d64a0-e4f6-4568-ad46-dc07499cd456 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:49.030312 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:49.030312 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: warnings.warn(msg) Jun 20 06:03:49.058876 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-c30d64a0-e4f6-4568-ad46-dc07499cd456 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.110504 Jun 20 06:03:49.059640 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:49.288692 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-309b001f-2363-4b28-bf78-78ac24a0e9d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:49.291221 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:49.291221 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:03:49.293920 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_api:SELECT=3 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:49.294795 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_cell0:SELECT=3 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:49.295531 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_cell1:SELECT=3 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:49.296268 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_cell0:SELECT=3 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:03:49.357631 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-309b001f-2363-4b28-bf78-78ac24a0e9d0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289861 Jun 20 06:03:49.358400 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:49 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:51.506284 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-c30d64a0-e4f6-4568-ad46-dc07499cd456 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:51.507289 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-c30d64a0-e4f6-4568-ad46-dc07499cd456 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001702 Jun 20 06:03:51.508016 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:51.632079 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-a23c4477-8201-4baa-839b-0e2d16b6be5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "name": "ds512M", "swap": 0, "ram": 512, "disk": 5, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:51.650621 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:51.650621 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:03:51.670530 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-a23c4477-8201-4baa-839b-0e2d16b6be5b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.153635 Jun 20 06:03:51.671325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:51.683368 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-32b02c4c-f33f-4660-bf4c-ebf21c85d53c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:51.684915 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:03:51.684915 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: warnings.warn(msg) Jun 20 06:03:51.717102 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-32b02c4c-f33f-4660-bf4c-ebf21c85d53c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037388 Jun 20 06:03:51.717667 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:53.849111 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-a23c4477-8201-4baa-839b-0e2d16b6be5b admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:53.850902 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-a23c4477-8201-4baa-839b-0e2d16b6be5b admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Jun 20 06:03:53.852340 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:53.945670 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-621b6ac7-cafa-487b-8b5e-bc1c42ab8cb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 1024, "id": "d2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:53.973439 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-621b6ac7-cafa-487b-8b5e-bc1c42ab8cb5 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.113256 Jun 20 06:03:53.989332 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-2ce3f766-29d9-4b98-9eeb-406324494050 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:53.995080 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:03:54.026637 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-2ce3f766-29d9-4b98-9eeb-406324494050 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041545 Jun 20 06:03:54.035904 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:56.184465 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-621b6ac7-cafa-487b-8b5e-bc1c42ab8cb5 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:56.185927 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-621b6ac7-cafa-487b-8b5e-bc1c42ab8cb5 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Jun 20 06:03:56.189332 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:56 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:56.267577 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-7fb3ba9a-35d8-422d-ac2b-1e5558e35464 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "ram": 2048, "rxtx_factor": 1.0, "disk": 10, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds2G"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:56.286192 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-7fb3ba9a-35d8-422d-ac2b-1e5558e35464 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.094245 Jun 20 06:03:56.286744 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:56.300679 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-efbef235-1540-49b3-8105-234c25a67779 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:56.325027 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-efbef235-1540-49b3-8105-234c25a67779 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027944 Jun 20 06:03:56.325610 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:03:58.437051 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-7fb3ba9a-35d8-422d-ac2b-1e5558e35464 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:03:58.438312 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-7fb3ba9a-35d8-422d-ac2b-1e5558e35464 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001763 Jun 20 06:03:58.438713 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:03:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:03:58.498869 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "swap": 0, "disk": 20, "vcpus": 4, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:58.516241 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071870 Jun 20 06:03:58.516869 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:03:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:03:58.528780 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-ac03c62d-456f-4493-88bd-11a2cf1d3682 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:03:58.550840 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-ac03c62d-456f-4493-88bd-11a2cf1d3682 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025683 Jun 20 06:03:58.551577 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1335 bytes} [Mon Jun 20 06:03:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:00.697487 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:00.698401 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002230 Jun 20 06:04:00.698798 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:00.763762 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-9ff1f2c9-db37-4cb4-aaed-6ec7affb20b8 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:00.787475 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-9ff1f2c9-db37-4cb4-aaed-6ec7affb20b8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082634 Jun 20 06:04:00.790874 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1291 bytes} [Mon Jun 20 06:04:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:02.957855 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:02.958827 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-c1d8c148-a23e-4d79-9512-475e931cfa24 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 20 06:04:02.959334 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:03.026624 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-45e0b578-3fdf-40d4-8abc-2685ca2b5f47 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "1", "vcpus": 1, "name": "m1.tiny", "os-flavor-access:is_public": true, "disk": 1, "rxtx_factor": 1.0}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:03.046042 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-45e0b578-3fdf-40d4-8abc-2685ca2b5f47 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.080425 Jun 20 06:04:03.046596 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:03.059009 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b6886d90-2e94-45df-bb15-1b646fc4e023 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:03.086923 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b6886d90-2e94-45df-bb15-1b646fc4e023 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031599 Jun 20 06:04:03.087514 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:03 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:05.611137 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-45e0b578-3fdf-40d4-8abc-2685ca2b5f47 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:05.612257 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-45e0b578-3fdf-40d4-8abc-2685ca2b5f47 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jun 20 06:04:05.612597 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:04:05.672020 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-e805217f-8076-4661-9c2e-7ccd24072edb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 20, "rxtx_factor": 1.0, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:05.689269 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-e805217f-8076-4661-9c2e-7ccd24072edb admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.070692 Jun 20 06:04:05.689809 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:05.702183 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-999a22c2-997b-4ee6-a1cf-76d3de7c2d8c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:05.725583 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-999a22c2-997b-4ee6-a1cf-76d3de7c2d8c admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026981 Jun 20 06:04:05.726118 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:07.979015 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-e805217f-8076-4661-9c2e-7ccd24072edb admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:07.980458 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-e805217f-8076-4661-9c2e-7ccd24072edb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Jun 20 06:04:07.980798 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:08.041381 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-e74dc642-09b2-470e-892d-5eec491cdb41 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "name": "m1.medium", "swap": 0, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:08.060449 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-e74dc642-09b2-470e-892d-5eec491cdb41 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073334 Jun 20 06:04:08.061041 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:08.076004 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-7bc50111-d311-472b-bf9b-9eb01bb03989 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:08.104565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-7bc50111-d311-472b-bf9b-9eb01bb03989 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034246 Jun 20 06:04:08.106189 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:08 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:10.202649 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-e74dc642-09b2-470e-892d-5eec491cdb41 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:10.203654 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-e74dc642-09b2-470e-892d-5eec491cdb41 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 20 06:04:10.204054 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:10.265428 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-1805c659-f82e-47cb-8e9c-fc34f9943870 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "name": "m1.large", "id": "4", "os-flavor-access:is_public": true, "disk": 80}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:10.283026 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-1805c659-f82e-47cb-8e9c-fc34f9943870 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073214 Jun 20 06:04:10.283562 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:04:10.295885 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-854ad5b2-7445-4c46-bac6-cb249cd4d72d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:10.319700 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-854ad5b2-7445-4c46-bac6-cb249cd4d72d admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027934 Jun 20 06:04:10.320287 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:12.448256 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-1805c659-f82e-47cb-8e9c-fc34f9943870 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:12.449968 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-1805c659-f82e-47cb-8e9c-fc34f9943870 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002081 Jun 20 06:04:12.451015 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:12.517395 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 8, "disk": 160, "swap": 0, "ram": 16384}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:12.536196 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.079150 Jun 20 06:04:12.536775 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1282 bytes} [Mon Jun 20 06:04:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:04:12.549697 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-14908a9d-171f-4be7-b605-3190af1a95aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:12.573627 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-14908a9d-171f-4be7-b605-3190af1a95aa admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027519 Jun 20 06:04:12.574402 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1332 bytes} [Mon Jun 20 06:04:12 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:04:37.005092 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.006097 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 20 06:04:37.006485 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:37.017109 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:37.065877 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-7828d085-fc69-4714-a168-ea975f512cf8 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:37.083466 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-7828d085-fc69-4714-a168-ea975f512cf8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.071005 Jun 20 06:04:37.084008 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1291 bytes} [Mon Jun 20 06:04:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:38.028894 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.029891 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-ea32ab43-6a34-4993-a3e8-f072d0dfa5ec admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Jun 20 06:04:38.030278 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:38.219530 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-8af411e6-c092-46b0-ab4b-ed2541f4141b admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.225504 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.wsgi [None req-8af411e6-c092-46b0-ab4b-ed2541f4141b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-8af411e6-c092-46b0-ab4b-ed2541f4141b admin admin] Request method failure captured: Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept: application/json Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept-Encoding: gzip, deflate Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Connection: keep-alive Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Content-Length: 0 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Host: 10.222.0.39 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-System-Scope: None Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: User-Agent: python-novaclient Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Auth-Token: gAAAAABisA32v6eGs_EYA8aqGzYr0KjySNjfWFaoGPL_nsRqZbe0A6a7DCTiCvmTgl1vVRNm2INc9fJ58XA0qr7AVPa6HCHBEX8JLAvAJpJr6SZYip-3fzQ1ezQP9qZIFJfQNnPRmvBx8LubvzZRMAMgiEpYQ9xhkJIVi31aWRAZOdj7B99z_2w Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Id: None Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Name: None Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Identity-Status: Confirmed Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Is-Admin-Project: True Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Id: default Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Name: Default Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Name: admin Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Role: admin,reader,member Jun 20 06:04:38.228837 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Roles: admin,reader,member Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant: admin Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Name: admin Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User: admin Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Id: default Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Name: Default Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Name: admin Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: method: > Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: exception: Flavor 42 could not be found. Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: action_args: {'id': '42'} Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:38.230565 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:38.231736 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.234652 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-8af411e6-c092-46b0-ab4b-ed2541f4141b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:38.236484 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-8af411e6-c092-46b0-ab4b-ed2541f4141b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.063520 Jun 20 06:04:38.236484 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:38.240839 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-64017719-6891-4be4-ac6b-cb86a4648e73 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.243708 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:04:38.263998 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-64017719-6891-4be4-ac6b-cb86a4648e73 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027213 Jun 20 06:04:38.264555 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:38.274301 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-ff6b3935-9112-4805-b894-6098c32df099 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.295324 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-ff6b3935-9112-4805-b894-6098c32df099 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024518 Jun 20 06:04:38.295855 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:38.306357 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-92ac04bf-2a6a-4504-94d2-30bf8ea5504b admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:38.312818 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.wsgi [None req-92ac04bf-2a6a-4504-94d2-30bf8ea5504b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-92ac04bf-2a6a-4504-94d2-30bf8ea5504b admin admin] Request method failure captured: Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept: application/json Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept-Encoding: gzip, deflate Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Connection: keep-alive Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Content-Length: 0 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Host: 10.222.0.39 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-System-Scope: None Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: User-Agent: python-novaclient Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Auth-Token: gAAAAABisA32v6eGs_EYA8aqGzYr0KjySNjfWFaoGPL_nsRqZbe0A6a7DCTiCvmTgl1vVRNm2INc9fJ58XA0qr7AVPa6HCHBEX8JLAvAJpJr6SZYip-3fzQ1ezQP9qZIFJfQNnPRmvBx8LubvzZRMAMgiEpYQ9xhkJIVi31aWRAZOdj7B99z_2w Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Id: None Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Name: None Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Identity-Status: Confirmed Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Is-Admin-Project: True Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Id: default Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Name: Default Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Name: admin Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Role: admin,reader,member Jun 20 06:04:38.316071 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Roles: admin,reader,member Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant: admin Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Name: admin Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User: admin Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Id: default Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Name: Default Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Name: admin Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: method: > Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: exception: Flavor 42 could not be found. Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: action_args: {'id': '42'} Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:38.317863 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:38.319481 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:38.320887 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-92ac04bf-2a6a-4504-94d2-30bf8ea5504b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:38.322137 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-92ac04bf-2a6a-4504-94d2-30bf8ea5504b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015534 Jun 20 06:04:38.322137 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:39.172874 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-ff6b3935-9112-4805-b894-6098c32df099 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.173891 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-ff6b3935-9112-4805-b894-6098c32df099 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jun 20 06:04:39.174310 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:39.361924 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-c01b87b7-158b-4444-b4e6-0edfd24a8690 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.367783 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.wsgi [None req-c01b87b7-158b-4444-b4e6-0edfd24a8690 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-c01b87b7-158b-4444-b4e6-0edfd24a8690 admin admin] Request method failure captured: Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept: application/json Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept-Encoding: gzip, deflate Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Connection: keep-alive Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Content-Length: 0 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Host: 10.222.0.39 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-System-Scope: None Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: User-Agent: python-novaclient Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Auth-Token: gAAAAABisA33ha1UKrQVoalhIfgFKkCmeuBCRIeKRohAIZEHYI3lI-cRhwWt7oZfduCpGOhoNHBmOWMj9zcUOQUCXuU7bY_CtBGxFxFp6YUvrcA4AMvkdya7W09kxdscSsB_78qjC5dnQSerF9iUqEWZT5XzhZmaCmC4kk12wBeayDnahdgItIE Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Id: None Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Name: None Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Identity-Status: Confirmed Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Is-Admin-Project: True Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Id: default Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Name: Default Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Name: admin Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Role: admin,reader,member Jun 20 06:04:39.369325 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Roles: admin,reader,member Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant: admin Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Name: admin Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User: admin Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Id: default Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Name: Default Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Name: admin Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: method: > Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: exception: Flavor 84 could not be found. Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: action_args: {'id': '84'} Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:39.370886 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:39.371849 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.373174 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-c01b87b7-158b-4444-b4e6-0edfd24a8690 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:39.374415 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-c01b87b7-158b-4444-b4e6-0edfd24a8690 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.060520 Jun 20 06:04:39.374415 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:39.381280 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-5c4e10f7-4c2b-46b1-985a-b15d36898d4e admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.394753 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-5c4e10f7-4c2b-46b1-985a-b15d36898d4e admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018119 Jun 20 06:04:39.396011 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:39.405293 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-3550c51e-f29a-4016-8937-95012e0dd499 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.418577 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-3550c51e-f29a-4016-8937-95012e0dd499 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016764 Jun 20 06:04:39.419088 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:39.428394 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-2f24ccbc-5b47-4670-b8bd-01739599e729 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:39.433639 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.wsgi [None req-2f24ccbc-5b47-4670-b8bd-01739599e729 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-2f24ccbc-5b47-4670-b8bd-01739599e729 admin admin] Request method failure captured: Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept: application/json Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept-Encoding: gzip, deflate Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Connection: keep-alive Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Content-Length: 0 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Host: 10.222.0.39 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-System-Scope: None Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: User-Agent: python-novaclient Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Auth-Token: gAAAAABisA33ha1UKrQVoalhIfgFKkCmeuBCRIeKRohAIZEHYI3lI-cRhwWt7oZfduCpGOhoNHBmOWMj9zcUOQUCXuU7bY_CtBGxFxFp6YUvrcA4AMvkdya7W09kxdscSsB_78qjC5dnQSerF9iUqEWZT5XzhZmaCmC4kk12wBeayDnahdgItIE Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Id: None Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Name: None Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Identity-Status: Confirmed Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Is-Admin-Project: True Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Id: default Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Name: Default Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Name: admin Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Role: admin,reader,member Jun 20 06:04:39.435133 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Roles: admin,reader,member Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant: admin Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Name: admin Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User: admin Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Id: default Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Name: Default Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Name: admin Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: method: > Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: exception: Flavor 84 could not be found. Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: action_args: {'id': '84'} Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:39.436630 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:39.437687 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:39.439037 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-2f24ccbc-5b47-4670-b8bd-01739599e729 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:39.440246 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-2f24ccbc-5b47-4670-b8bd-01739599e729 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011979 Jun 20 06:04:39.440246 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Mon Jun 20 06:04:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 06:04:40.270897 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-3550c51e-f29a-4016-8937-95012e0dd499 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.271901 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-3550c51e-f29a-4016-8937-95012e0dd499 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002082 Jun 20 06:04:40.272286 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:40.460399 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-a15df28e-b647-4880-b265-77a6b6d21197 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.466078 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.wsgi [None req-a15df28e-b647-4880-b265-77a6b6d21197 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-a15df28e-b647-4880-b265-77a6b6d21197 admin admin] Request method failure captured: Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept: application/json Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Accept-Encoding: gzip, deflate Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Connection: keep-alive Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Content-Length: 0 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Host: 10.222.0.39 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Openstack-System-Scope: None Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: User-Agent: python-novaclient Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Auth-Token: gAAAAABisA34qDbv74ZPJmX4Vu8JZDTH6wX_85kw3-N1vwE1UBmt9oI-hrye-0lyRWK7sGrQvNCRcPRHF15L__X4bFyoayPExbSu_iE01n9J_5sECQwE0tEkohL3OvZhvRz_XrxDOl1GVyQxCOTYi1W7Flpw8aZWhBAmR5A6Fc5bNNs6PvASqsc Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Id: None Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Domain-Name: None Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Identity-Status: Confirmed Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Is-Admin-Project: True Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Id: default Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Domain-Name: Default Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Project-Name: admin Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Role: admin,reader,member Jun 20 06:04:40.467567 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Roles: admin,reader,member Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant: admin Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-Tenant-Name: admin Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User: admin Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Id: default Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Domain-Name: Default Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: X-User-Name: admin Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: method: > Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: exception: Flavor 451 could not be found. Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: action_args: {'id': '451'} Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:40.469325 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:40.470376 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.471709 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-a15df28e-b647-4880-b265-77a6b6d21197 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103214) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:40.473000 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-a15df28e-b647-4880-b265-77a6b6d21197 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060993 Jun 20 06:04:40.473000 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 20 06:04:40.478499 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-ff930a5a-dd37-4424-aa69-5f8ac993caa9 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.494360 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-ff930a5a-dd37-4424-aa69-5f8ac993caa9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019273 Jun 20 06:04:40.494832 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:04:40.504596 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.519979 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018954 Jun 20 06:04:40.520880 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:04:40.530127 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-e176c638-8e1e-4d8d-b51e-8090cc89caf9 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:40.535485 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.wsgi [None req-e176c638-8e1e-4d8d-b51e-8090cc89caf9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-e176c638-8e1e-4d8d-b51e-8090cc89caf9 admin admin] Request method failure captured: Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept: application/json Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Accept-Encoding: gzip, deflate Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Connection: keep-alive Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Content-Length: 0 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Host: 10.222.0.39 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-Api-Version: compute 2.90 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Openstack-System-Scope: None Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: User-Agent: python-novaclient Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Auth-Token: gAAAAABisA34qDbv74ZPJmX4Vu8JZDTH6wX_85kw3-N1vwE1UBmt9oI-hrye-0lyRWK7sGrQvNCRcPRHF15L__X4bFyoayPExbSu_iE01n9J_5sECQwE0tEkohL3OvZhvRz_XrxDOl1GVyQxCOTYi1W7Flpw8aZWhBAmR5A6Fc5bNNs6PvASqsc Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Id: None Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Domain-Name: None Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Identity-Status: Confirmed Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Is-Admin-Project: True Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Openstack-Nova-Api-Version: 2.90 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Id: default Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Domain-Name: Default Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Project-Name: admin Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Role: admin,reader,member Jun 20 06:04:40.537508 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Roles: admin,reader,member Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9e16e10aec7d4a579d849fde0e5b0904"}]}] Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant: admin Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Id: 9e16e10aec7d4a579d849fde0e5b0904 Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-Tenant-Name: admin Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User: admin Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Id: default Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Domain-Name: Default Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Id: 665bc0e94a714a5594465a5b89b022aa Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: X-User-Name: admin Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: method: > Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: exception: Flavor 451 could not be found. Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: action_args: {'id': '451'} Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:04:40.539103 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:40.540262 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: ERROR nova.api.openstack.wsgi Jun 20 06:04:40.541623 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-e176c638-8e1e-4d8d-b51e-8090cc89caf9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103213) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:04:40.542894 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-e176c638-8e1e-4d8d-b51e-8090cc89caf9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012336 Jun 20 06:04:40.542894 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:04:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 20 06:04:41.349320 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:41.350316 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Jun 20 06:04:41.350693 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:41.540075 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-1837f5c7-c244-4d13-a44f-73d4dea777a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:41.571827 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-1837f5c7-c244-4d13-a44f-73d4dea777a0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.083807 Jun 20 06:04:41.572320 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:42.397825 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:42.398852 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 20 06:04:42.399238 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:04:42.591227 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-78e1acd7-3ec1-4438-aa63-1c0b04cc7631 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:42.607950 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-78e1acd7-3ec1-4438-aa63-1c0b04cc7631 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.068970 Jun 20 06:04:42.608490 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:43.429635 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:43.430639 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jun 20 06:04:43.431033 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:43.622247 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-723e4c7d-81c0-46c6-bbf8-4c4e016734d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:43.639942 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-723e4c7d-81c0-46c6-bbf8-4c4e016734d8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.068617 Jun 20 06:04:43.640426 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:44.486171 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:44.487171 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 20 06:04:44.487586 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:44.677858 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-4e219ab0-a6ab-48de-b8fb-a1b61f59c1a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:04:44.695910 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-4e219ab0-a6ab-48de-b8fb-a1b61f59c1a7 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.070732 Jun 20 06:04:44.696382 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Mon Jun 20 06:04:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:04:45.515513 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.516519 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Jun 20 06:04:45.516934 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:04:45.706807 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-6635535f-7933-4bcd-8548-3c73d53ce002 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:04:45.726063 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-6635535f-7933-4bcd-8548-3c73d53ce002 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.072375 Jun 20 06:04:45.726591 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Mon Jun 20 06:04:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:05:32.723686 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.724694 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-b8d0029e-bf06-410b-9d05-529b72834987 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 20 06:05:32.725146 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 930 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:05:32.735315 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:32.783632 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-436ceb7b-ad90-4ae4-811b-eb5131983b1f admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.803043 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-436ceb7b-ad90-4ae4-811b-eb5131983b1f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072275 Jun 20 06:05:32.803567 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1291 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:05:32.825673 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-e26c68c6-e372-476f-855f-94dcc86387ac admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.829747 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG dbcounter [-] [103214] Writing DB stats nova_api:SELECT=14 {{(pid=103214) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:05:32.835251 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-e26c68c6-e372-476f-855f-94dcc86387ac admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013158 Jun 20 06:05:32.835769 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1282 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:05:32.847982 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-4672a484-e65b-4d94-8504-25fbd805e367 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.855521 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-4672a484-e65b-4d94-8504-25fbd805e367 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011100 Jun 20 06:05:32.856018 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1285 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:32.867552 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.875556 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011452 Jun 20 06:05:32.876060 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1285 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:05:32.887076 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-d8cd576a-302b-4389-a071-8c65075ed0f8 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:05:32.897227 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-d8cd576a-302b-4389-a071-8c65075ed0f8 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013641 Jun 20 06:05:32.898099 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1282 bytes} [Mon Jun 20 06:05:32 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:09:05.056508 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:05.057587 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jun 20 06:09:05.057980 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:05.199355 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_api:SELECT=6 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:05.316100 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:05.317290 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:05.317290 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:09:05.318493 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:05.318927 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:05.319703 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:05.320183 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:05.354179 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-c2216185-1991-4dd5-9bd5-49932a86da2d admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.156203 Jun 20 06:09:05.354731 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:09:06.186177 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:06.187751 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 20 06:09:06.188144 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:06.380624 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:06.381821 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:06.381821 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:09:06.382995 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:06.383427 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:06.384204 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:06.384625 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:06.404251 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-8acd6e44-d6a2-4ddc-9c55-a7dcacd917aa admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.075468 Jun 20 06:09:06.404756 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:06 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:09:17.684474 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:17.685575 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Jun 20 06:09:17.685965 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:17.834440 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_cell0:SELECT=4 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:17.835172 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_cell1:SELECT=4 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:17.835773 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG dbcounter [-] [103213] Writing DB stats nova_api:SELECT=8 {{(pid=103213) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:09:17.883744 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:17.884959 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:17.884959 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:09:17.886168 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:17.886598 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:17.887386 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:17.887818 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:17.913072 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-f6482b5c-9366-4fc1-9339-a0f3d981aa85 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083510 Jun 20 06:09:17.913645 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:17 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:09:18.744636 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: DEBUG nova.api.openstack.wsgi [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] Calling method '>' {{(pid=103214) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:18.745752 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: INFO nova.api.openstack.requestlog [None req-503c40fb-534d-4888-99aa-7828ed5cb216 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 20 06:09:18.746152 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: [pid: 103214|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Mon Jun 20 06:09:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:09:18.940613 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG nova.api.openstack.wsgi [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] Calling method '>' {{(pid=103213) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:09:18.941813 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 20 06:09:18.941813 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: warnings.warn(msg) Jun 20 06:09:18.942990 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.943432 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.944259 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:09:18.944685 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: DEBUG oslo_concurrency.lockutils [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103213) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:09:18.966739 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: INFO nova.api.openstack.requestlog [None req-baf6031a-6152-4cdd-aa48-11118e85c8c2 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078040 Jun 20 06:09:18.967233 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: [pid: 103213|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Mon Jun 20 06:09:18 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:10:15.710933 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: Mon Jun 20 06:10:15 2022 - graceful shutdown triggered... Jun 20 06:10:15.711022 dv-cinder-804035-47-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 20 06:10:15.711961 dv-cinder-804035-47-iscsi devstack@n-api.service[103214]: Gracefully killing worker 2 (pid: 103214)... Jun 20 06:10:15.712376 dv-cinder-804035-47-iscsi devstack@n-api.service[103213]: Gracefully killing worker 1 (pid: 103213)... Jun 20 06:10:16.712916 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: worker 1 buried after 1 seconds Jun 20 06:10:16.712916 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: worker 2 buried after 1 seconds Jun 20 06:10:16.712916 dv-cinder-804035-47-iscsi devstack@n-api.service[103212]: goodbye to uWSGI. Jun 20 06:10:16.714414 dv-cinder-804035-47-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 20 06:10:16.714959 dv-cinder-804035-47-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 20 06:10:16.717862 dv-cinder-804035-47-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 20 06:10:16.731162 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 20 06:10:16 2022] *** Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: nodename: dv-cinder-804035-47-iscsi Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: machine: x86_64 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: clock source: unix Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: pcre jit disabled Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: detected number of CPU cores: 4 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: current working directory: / Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: detected binary path: /usr/bin/uwsgi-core Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: your processes number limit is 47680 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: your memory page size is 4096 bytes Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: detected max file descriptor number: 2048 Jun 20 06:10:16.733383 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: lock engine: pthread robust mutexes Jun 20 06:10:16.734321 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: thunder lock: enabled Jun 20 06:10:16.734321 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 20 06:10:16.734321 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 20 06:10:16.783174 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: Python main interpreter initialized at 0x55ad8ab209c0 Jun 20 06:10:16.783174 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: python threads support enabled Jun 20 06:10:16.783174 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: your server socket listen backlog is limited to 100 connections Jun 20 06:10:16.783174 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: your mercy for graceful operations on workers is 90 seconds Jun 20 06:10:16.783623 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: mapped 403077 bytes (393 KB) for 2 cores Jun 20 06:10:16.783623 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: *** Operational MODE: preforking *** Jun 20 06:10:16.783889 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: *** uWSGI is running in multiple interpreter mode *** Jun 20 06:10:16.783889 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: spawned uWSGI master process (pid: 117567) Jun 20 06:10:16.784099 dv-cinder-804035-47-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 20 06:10:16.786477 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: spawned uWSGI worker 1 (pid: 117585, cores: 1) Jun 20 06:10:16.793211 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: spawned uWSGI worker 2 (pid: 117586, cores: 1) Jun 20 06:10:16.793542 dv-cinder-804035-47-iscsi devstack@n-api.service[117567]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 20 06:10:17.449052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:10:17.452650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 20 06:10:18.674272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:18.674272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: from cryptography.utils import int_from_bytes Jun 20 06:10:18.675111 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:18.675111 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: from cryptography.utils import int_from_bytes Jun 20 06:10:18.675998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:18.675998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: from cryptography.utils import int_from_bytes Jun 20 06:10:18.676430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 20 06:10:18.676430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: from cryptography.utils import int_from_bytes Jun 20 06:10:21.132036 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:10:21.132564 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.134434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.134850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.135127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.135415 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.135727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.136059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.136401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.136678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.137033 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.137374 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-47-iscsi {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.137710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.138031 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.138351 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.138680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.138992 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.139328 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.139659 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.140163 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.141620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.141620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.141846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.142054 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.142343 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.142664 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.142999 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.143326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.143662 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.144538 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.145045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-47-iscsi {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.145377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.145703 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.146045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.146466 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.146785 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.147101 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.147457 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.147763 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.148084 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.148423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.148797 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.149115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.149448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.149767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.150084 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.150409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.150740 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.151057 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.151375 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.151637 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.151955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.152287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.152618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.152982 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.153249 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.153511 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.153845 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.154176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.154496 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.154817 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.155135 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.155451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.155767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.156083 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.156400 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.156759 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.157065 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.157394 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.157725 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.158042 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.158372 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.158791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.159059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.159433 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.160304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.160638 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.160983 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.161314 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.161647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.161966 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.162421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.162596 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.162916 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.163270 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.163591 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.163854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.164180 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.164492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.164846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.165163 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.165483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.165801 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.166113 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.166291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 20 06:10:21.166782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 20 06:10:21.166946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.166946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.167244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 20 06:10:21.167412 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.167560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 20 06:10:21.167713 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.167858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 20 06:10:21.168011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.168174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.168333 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.168487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.168640 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.168853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169937 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.169937 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.170240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.170393 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.170538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171066 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.171984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-804035-47-iscsi {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172445 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172790 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.172951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173097 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173395 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173713 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.173886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.174109 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.174269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.174703 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.174908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.175488 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.175662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.175810 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.175963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.176781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177693 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.177991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.178897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-804035-47-iscsi {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179532 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.179984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.180141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.180141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.180423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.180576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.180791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.181314 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.181480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.181480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.181769 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.181924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.182070 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.182223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.182376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.182529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.182674 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.182832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.182985 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.183138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.183292 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.183447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.183602 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.183756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.183909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.184054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.184266 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.184416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.184570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.184887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.185059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.185290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.185451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.185699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.185865 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.186019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.186176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.186329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.186483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.186637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.186867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.187016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.187161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.187305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.187464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.188172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.188172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.188473 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.188628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.188817 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.188974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.189128 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.189281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.189684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.189848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.190003 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.190170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.190318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.190463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.191664 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.191832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.191980 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.192134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.192294 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.192447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.192607 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.192786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.192950 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.193107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.193273 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.193419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.193573 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.193727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.193881 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.194035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.194181 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.194335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.194488 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.194641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.194823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.195138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.195321 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.195559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.195726 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.195959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.196110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.196256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.196411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.196571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.196788 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.196951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.197106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.197259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.197411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.197577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.197730 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.197876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.198028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.198172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.198332 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.198486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.198639 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.198792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.198953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.199144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.199304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.199451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.199649 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.199794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.199938 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.200083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.200242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.200397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.200550 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.200730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.200894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.201041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.201795 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.201968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.202118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.202283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.202441 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.202759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.202922 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.203076 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.203223 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.203369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.203546 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.203647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.203744 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.203839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.203926 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.204018 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.204104 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.204206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.204302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.204395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.204489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.204591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.204691 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.204806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.204909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.205021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.205136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.205235 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.205344 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.205431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.205544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.205639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.205734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.205835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.205948 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.206035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.206131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.206233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.206851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.206973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207063 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.207154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.207336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207424 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.207523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.207698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207786 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.207871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.207966 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.208053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.208139 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.208231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.208318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.208410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.208509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.208595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.208680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.208940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209039 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.209135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.209324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209412 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.209497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209582 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.209666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209761 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.209847 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.209933 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.210118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.210313 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.210493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.210665 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.210856 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.210942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.211027 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.211118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.211205 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.211373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.211470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.211579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.211862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.211957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 20 06:10:21.212045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212233 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212414 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212601 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.212948 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213275 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213625 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.213954 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214264 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.214928 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.215950 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.216910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217089 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217415 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.217877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218213 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218690 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.218842 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219012 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.219776 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220437 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.220799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221440 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221663 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.221765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.222814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223156 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223467 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.223791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224337 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224429 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224660 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.224783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225107 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225652 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.225993 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.226338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.226613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.226719 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.226953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.227054 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.227290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.227373 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228193 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228380 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228536 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.228955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229179 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229580 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.229911 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.230876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232675 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.232799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.233733 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.233832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.233925 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234373 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.234946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235480 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235645 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235801 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.235977 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236674 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.236884 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237479 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.237888 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238207 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238413 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.238825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239402 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239502 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239731 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.239845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240373 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.240834 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241035 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241450 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241756 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.241980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242078 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242301 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242702 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.242926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243331 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243824 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.243914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.244943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245565 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245807 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.245906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246210 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246579 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.246901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247121 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247440 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247757 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.247849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248080 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248396 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248749 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.248855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249473 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.249789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250098 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250319 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.250961 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.251906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252004 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252548 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252889 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.252993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.253770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.253992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254093 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254578 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.254998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.255252 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.255352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.255594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.255699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.255914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256001 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256560 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.256907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257002 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257229 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257546 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.257954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258505 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.258908 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.259136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.259234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.259458 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.259557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.259932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260473 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260723 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.260922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.261955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262068 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262267 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.262966 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.263426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.263737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.263857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.263974 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264138 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264248 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264385 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264596 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.264959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.265051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.265393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.265622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.265769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.265865 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266303 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266592 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.266919 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.267170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.267335 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.267500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.267642 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.267915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.268022 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.268239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.268341 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.268555 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.268657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270180 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270565 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270735 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.270833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271012 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271333 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271655 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.271972 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272617 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.272946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.273894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274579 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.274871 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275101 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275420 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.275840 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276518 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.276892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277192 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277536 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.277868 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278018 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278346 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278668 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.278932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279082 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279428 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.279919 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280726 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.280919 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281229 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281547 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.281885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282354 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282655 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.282967 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283269 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.283880 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284522 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.284962 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285591 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.285918 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286569 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286895 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.286999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287215 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.287975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288202 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288527 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288871 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.288967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289516 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.289968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.290953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291298 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291827 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.291928 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292244 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.292902 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293216 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.293856 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.294823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295133 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295444 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.295988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296123 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296395 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.296962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297752 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.297924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298487 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.298914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.299949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.300153 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.300460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.300553 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.300808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.300905 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301249 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301566 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.301893 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302211 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.302852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303167 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.303825 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.304813 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305128 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.305852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306203 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306517 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.306922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307066 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307695 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.307979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308305 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.308962 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309496 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309833 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.309932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310260 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310494 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.310922 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311567 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311788 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.311887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312201 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312521 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312760 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.312867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313081 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313399 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313710 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.313809 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314117 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.314780 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.315001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.315102 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.315335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.315436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.316286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.316395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.316613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.316898 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317097 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317381 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.317932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318036 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318399 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318685 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318898 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.318991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319218 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319638 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319859 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.319950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.320930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321253 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321478 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.321912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322552 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.322860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323496 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.323807 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324058 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324392 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324754 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.324850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325098 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325557 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.325833 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326066 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326710 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.326824 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327034 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327362 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.327791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.328806 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329125 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.329902 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330246 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.330888 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.331025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.331297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332261 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332819 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.332907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333030 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333356 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.333869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334363 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334705 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.334875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335050 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335474 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335758 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.335941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.336097 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.336261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.336418 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.336669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.336839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337159 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.337872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338087 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338389 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338698 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.338977 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339278 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339563 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.339864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.340995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341442 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341777 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.341919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342105 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342433 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342753 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.342890 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.343958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344299 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344639 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.344997 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345749 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.345971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346290 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346617 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.346993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.347127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.347394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.347622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.347729 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.347938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.348237 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.348367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.348602 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.348714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.348953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349615 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349788 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.349938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350530 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.350960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351210 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351552 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.351968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352611 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.352947 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353170 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353584 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.353897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354120 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.354837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355066 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355706 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.355797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356446 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.356997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357146 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357314 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.357962 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358284 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358601 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.358920 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359246 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359564 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.359887 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.360292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.360474 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.360576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.360824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.360930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361145 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361567 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.361889 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362225 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.362894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363230 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363540 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363856 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.363999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.364184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.364342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.364511 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.364672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.364903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365238 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.365979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366472 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366817 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.366947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367164 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367486 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367869 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.367965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.368315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.368443 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.368648 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.369074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.369169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.369398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.369679 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.369786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.370035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.370287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.370387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.370712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.370901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.371024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.371343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.371467 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.371670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.371996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.372103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.372320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.372641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.372778 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.372993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.373304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.373410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.373629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.373862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.373964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.374263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.374444 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.374608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.374927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.375070 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.375273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.375532 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.375685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.375916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.376099 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.376236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.376551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.376746 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.377108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.377272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.377446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.377766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.377867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.378661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.378944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.379046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.379321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.379560 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.379661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.379971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380473 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380842 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.380974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381194 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381537 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381875 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.381979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382357 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382611 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.382942 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.383169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.383269 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.383713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.383886 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384482 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.384851 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385491 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.385828 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386158 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386518 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.386814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387498 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.387796 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388112 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388435 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388652 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.388993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389087 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389426 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389728 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.389955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390585 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.390990 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391537 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.391957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392167 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.392928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.393129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.393230 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.393441 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.393532 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.393809 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.394420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.394639 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.394778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.394957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395278 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395593 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.395909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396542 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.396993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397324 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.397979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.398200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.398308 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.398525 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.398623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.398863 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399537 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.399855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400183 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.400897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401228 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401539 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.401855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402201 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402515 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.402839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403170 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403494 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.403814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.404798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405347 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.405988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406089 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406633 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.406956 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.407942 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408372 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408749 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.408943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.409065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.409262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.409440 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.409632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.409849 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410504 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.410983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.411131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.411344 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.411488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.411675 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.411823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412004 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412327 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:10:21.412794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.412992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.413329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.413650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.413984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.414309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.414651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.415005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.415347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.415684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.416046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.416316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.416635 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.416983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.417312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.417632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.417950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.418263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.418941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.418941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.419198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.419511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.419826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.420144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.420458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.420796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.421114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.421430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.421744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.422058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.422378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.422690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.423005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.423322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.423633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.423948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.424848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.424848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.425054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.425514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.425848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.426186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.426512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.426846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.427180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.427510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.427835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.428182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.428512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.428861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.429187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.429513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.429833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.430156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.430498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.430837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.431157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.431495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.431824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.432155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.432483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.432838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.433182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.433504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.433825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.434151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.434473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.434795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.435122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.435449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.435786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.436122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.436446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.436806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.437149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.437512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.437837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.438193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.438539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.438867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.439189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.439506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 20 06:10:21.439760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117585) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 20 06:10:21.475319 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO dbcounter [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Registered counter for database nova_api Jun 20 06:10:21.495858 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_db.sqlalchemy.engines [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.502577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writer thread running {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.504039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO dbcounter [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Registered counter for database nova_api Jun 20 06:10:21.524873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.531319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writer thread running {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.560065 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.context [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e28d6b1b-8395-40bc-a597-ebf7d975d5d1(cell1) {{(pid=117586) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:10:21.564321 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.566512 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.567510 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.569561 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.571576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO dbcounter [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Registered counter for database nova_cell0 Jun 20 06:10:21.575612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO dbcounter [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Registered counter for database nova_cell1 Jun 20 06:10:21.584116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_db.sqlalchemy.engines [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.587299 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_db.sqlalchemy.engines [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.590219 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writer thread running {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.590647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.context [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e28d6b1b-8395-40bc-a597-ebf7d975d5d1(cell1) {{(pid=117585) load_cells /opt/stack/nova/nova/context.py:464}} Jun 20 06:10:21.594812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.596416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.597307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:10:21.599490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:10:21.601514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO dbcounter [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Registered counter for database nova_cell0 Jun 20 06:10:21.605541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO dbcounter [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Registered counter for database nova_cell1 Jun 20 06:10:21.613876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.615732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.623203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writer thread running {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.623548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writer thread running {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.734234 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writer thread running {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.744190 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO dbcounter [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Registered counter for database nova_cell0 Jun 20 06:10:21.752899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_db.sqlalchemy.engines [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.758044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writer thread running {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:21.777389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO dbcounter [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Registered counter for database nova_cell0 Jun 20 06:10:21.784093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_db.sqlalchemy.engines [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117585) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 20 06:10:21.788670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writer thread running {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 20 06:10:22.085351 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: WARNING keystonemiddleware.auth_token [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:22.092742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: WARNING keystonemiddleware.auth_token [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:22.127614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: WARNING keystonemiddleware.auth_token [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:22.135560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: WARNING keystonemiddleware.auth_token [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:22.447441 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: WARNING keystonemiddleware.auth_token [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:22.453599 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: WARNING keystonemiddleware.auth_token [None req-73b6e0d4-5ff8-4a49-97fe-b4e01757fd5b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:22.460748 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad8ab209c0 pid: 117586 (default app) Jun 20 06:10:22.491792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: WARNING keystonemiddleware.auth_token [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 20 06:10:22.497903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: WARNING keystonemiddleware.auth_token [None req-cfa11745-63f7-407b-bc70-2f75d4b18ddd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 20 06:10:22.503298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ad8ab209c0 pid: 117585 (default app) Jun 20 06:11:02.588257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.589261 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.594036 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:02.594036 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:03.728949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-69d2b95f-7eff-4f8a-9367-9bf96beac107 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Action: 'create', calling method: .version_select at 0x7f21ef768700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-838258108"}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:05.280076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-69d2b95f-7eff-4f8a-9367-9bf96beac107 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 2.707726 Jun 20 06:11:05.288358 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1154 bytes} [Mon Jun 20 06:11:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 2718 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:11:05.623385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0bd4afb6-82b4-4643-bb88-c1e55d547a6b tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef81a310>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:05.679137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.680352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.683096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:05.684526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:06.114222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0bd4afb6-82b4-4643-bb88-c1e55d547a6b tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 200 len: 344 microversion: 2.1 time: 0.823920 Jun 20 06:11:06.115467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:05 2022] GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 344 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:07.130997 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-553a948c-d2b2-4e4c-83b6-1a953a6c0ac6 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef62e550>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:07.267599 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-553a948c-d2b2-4e4c-83b6-1a953a6c0ac6 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 200 len: 345 microversion: 2.1 time: 0.143764 Jun 20 06:11:07.269012 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:07 2022] GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 345 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:07.281630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f52bdaa1-a9ac-4010-ba14-80850616fde7 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Action: 'create', calling method: .version_select at 0x7f21ef66f550>, body: {"snapshot": {"volume_id": "5ef609e3-e90e-40cb-af84-eeb8dec0a06c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-267464174"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:07.607105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f52bdaa1-a9ac-4010-ba14-80850616fde7 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.330365 Jun 20 06:11:07.607684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 2/4] 10.222.0.39 () {60 vars in 1161 bytes} [Mon Jun 20 06:11:07 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:07.619701 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d6318a22-78b6-48b5-a56e-4bfc0bfe6f75 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef62e8b0>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:07.735688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d6318a22-78b6-48b5-a56e-4bfc0bfe6f75 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.121289 Jun 20 06:11:07.738733 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:07 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:07.749049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c2ba7a8f-c06a-4556-bf2f-83ffccf1167c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef66fd30>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:07.866780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c2ba7a8f-c06a-4556-bf2f-83ffccf1167c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.122834 Jun 20 06:11:07.867746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1139 bytes} [Mon Jun 20 06:11:07 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:07.878855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-97d7fa51-8c28-48cf-acd8-b9cabec4c7e5 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef62ed30>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:07.921402 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-97d7fa51-8c28-48cf-acd8-b9cabec4c7e5 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.047221 Jun 20 06:11:07.922171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:07 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:08.936678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b3c6dd4a-e760-44b3-b076-17a642b75451 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef63aa60>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:08.993057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b3c6dd4a-e760-44b3-b076-17a642b75451 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.062635 Jun 20 06:11:08.993779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:08 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:10.005854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b1599e21-eb81-4217-8aa3-44d2c03acb7d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef645430>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:10.082455 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b1599e21-eb81-4217-8aa3-44d2c03acb7d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.081282 Jun 20 06:11:10.083595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 5/9] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:09 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:11.103186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5b80b043-ce27-482a-8af5-2f9917855f08 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef63a8b0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:11.177771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5b80b043-ce27-482a-8af5-2f9917855f08 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.085841 Jun 20 06:11:11.178967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:11 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:12.191154 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-001bcaf7-54e2-457e-84cf-b090267f1e83 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef62ed30>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:12.249558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-001bcaf7-54e2-457e-84cf-b090267f1e83 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.063102 Jun 20 06:11:12.250411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:12 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:13.261773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-19a52a11-280f-490f-9c88-97f27f3ffbc5 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef63a040>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:13.317001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-19a52a11-280f-490f-9c88-97f27f3ffbc5 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.059192 Jun 20 06:11:13.317685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:13 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:14.330871 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-158871cf-726f-434a-8831-f0df5b8ab8c9 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef62e8b0>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:14.463148 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-158871cf-726f-434a-8831-f0df5b8ab8c9 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.137655 Jun 20 06:11:14.465037 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:14 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:15.480596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0bd20e93-6520-47cd-acfd-dc433b1c8411 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef66fee0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:15.544002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0bd20e93-6520-47cd-acfd-dc433b1c8411 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 287 microversion: 2.1 time: 0.069766 Jun 20 06:11:15.544727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 7/14] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:15 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:15.556501 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-823fa80b-98fd-437e-bfb4-dc00e66d995a tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef645670>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:15.745157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-823fa80b-98fd-437e-bfb4-dc00e66d995a tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 202 len: 0 microversion: 2.1 time: 0.193035 Jun 20 06:11:15.746770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 8/15] 10.222.0.39 () {58 vars in 1253 bytes} [Mon Jun 20 06:11:15 2022] DELETE /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:15.758061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5c090883-970f-4ff2-b5c7-551b7bf1a05d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef6450d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:15.863327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5c090883-970f-4ff2-b5c7-551b7bf1a05d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.111046 Jun 20 06:11:15.867222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:15 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:16.124374 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1922911403", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "networks": [{"uuid": "225dcb61-2aa4-414d-98af-8bc63bc06b61"}]}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:16.353869 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.network.neutron [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] validate_networks() for [('225dcb61-2aa4-414d-98af-8bc63bc06b61', None, None, None, None, None)] {{(pid=117586) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:16.874610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3c8f10cc-f445-453a-af3d-3bcf2e2e8c5e tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef66ff70>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:16.938601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3c8f10cc-f445-453a-af3d-3bcf2e2e8c5e tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.067875 Jun 20 06:11:16.940236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 9/17] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:16 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:17.952420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cb2ff9ad-4d47-4a84-8fa5-3ae404dafbdf tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef63af70>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:18.307430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cb2ff9ad-4d47-4a84-8fa5-3ae404dafbdf tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 200 len: 286 microversion: 2.1 time: 0.359917 Jun 20 06:11:18.308028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 10/18] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:17 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 286 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:18.687375 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Flavor limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:18.687800 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Image limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:18.688299 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Flavor pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:18.688739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Image pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:18.689222 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:18.740528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:18.741018 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:18.750490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:18.750968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:18.917309 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Getting quotas for project a1c5be30cc344f1cacb822eb5b55d461. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:18.953279 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Getting quotas for user 8f811cc65238425a85c2f8c5828984d7 and project a1c5be30cc344f1cacb822eb5b55d461. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:18.989377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Going to run 1 instances... {{(pid=117586) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:18.995867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:19.157619 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7a5720cb-9907-4ae6-aa51-d0552c1037bf tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.270085 Jun 20 06:11:19.165028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 9/19] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 3278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:19.170012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4c643739-f36f-4305-84f3-ae578f422e79 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.171544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4c643739-f36f-4305-84f3-ae578f422e79 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:19.322696 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-152cff5e-5581-4bc6-a9dd-d56d17014a2d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21eecd8160>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.389559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-152cff5e-5581-4bc6-a9dd-d56d17014a2d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] HTTP exception thrown: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-152cff5e-5581-4bc6-a9dd-d56d17014a2d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Request method failure captured: Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 HTTP/1.1 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA92rRn_pqt4KAGifh5FVYrLYf2eZkgA58Dig5_D6NrAJwEHtNKNbxNrGtceDOGC0DeZrmu5DUgOmaOaxFuKqZP6LQWp1UqKP4VySFidvGepeQK0MzwJM9wuBR5CF912gxCFfKbFP6rWbm7XDiXrEUnA7KFVhDJTvq_N_eASTZtyV58 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:11:19.397151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}] Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 90233eaed7c24bfca8e83f6e0f66c950 Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': '3c02ea53-0d60-4645-9b62-5893b664e271'} Jun 20 06:11:19.398470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. (HTTP 404) (Request-ID: req-aff44302-1350-4611-bdf2-3fb0d45678f9) Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.399177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:19.400160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 20 06:11:19.401110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-152cff5e-5581-4bc6-a9dd-d56d17014a2d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Returning 404 to user: Snapshot 3c02ea53-0d60-4645-9b62-5893b664e271 could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:19.402071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-152cff5e-5581-4bc6-a9dd-d56d17014a2d tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271" status: 404 len: 111 microversion: 2.1 time: 0.083239 Jun 20 06:11:19.410972 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 10/20] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-snapshots/3c02ea53-0d60-4645-9b62-5893b664e271 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:19.423523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4f0c2895-d69a-4de7-afd3-80786aafdf12 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ee4b5670>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.480536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4c643739-f36f-4305-84f3-ae578f422e79 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:19.526405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4c643739-f36f-4305-84f3-ae578f422e79 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1215 microversion: 2.1 time: 0.360323 Jun 20 06:11:19.533055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1215 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:19.636823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4f0c2895-d69a-4de7-afd3-80786aafdf12 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 202 len: 0 microversion: 2.1 time: 0.224053 Jun 20 06:11:19.638436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 11/22] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:19 2022] DELETE /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:11:19.663000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0ab8aece-e4ea-499a-a054-0a2d85dd1340 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef66f1f0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:19.747194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0ab8aece-e4ea-499a-a054-0a2d85dd1340 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 200 len: 344 microversion: 2.1 time: 0.100129 Jun 20 06:11:19.753052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:19 2022] GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.087216 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0e1466ec-1cb8-4115-953d-ec24190b7788 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: .version_select at 0x7f21ee4b5af0>, body: {"keypair": {"name": "tempest-keypair-973815044", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEzUpO8UtCTXDQIqIuuSYAdb9gedJNwHQaznPBQMLOLmfjA3J1TSdj4LrHK2Byu+rQDrgSdRLIM4w5DG/avxteNO9R98qUByVdaK9fV0LCXOxjMS6zpMtzdHAyUpM3hjRQ=="}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:20.118864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-0e1466ec-1cb8-4115-953d-ec24190b7788 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:20.125025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-0e1466ec-1cb8-4115-953d-ec24190b7788 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for user 498822fcffaf4cc79532c487418cb11c and project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:20.217991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0e1466ec-1cb8-4115-953d-ec24190b7788 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.471892 Jun 20 06:11:20.219606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 12/24] 10.222.0.39 () {62 vars in 1199 bytes} [Mon Jun 20 06:11:19 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 474 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 20 06:11:20.506545 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b1e7d278-1c11-4035-89a0-44253110f0b5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: .version_select at 0x7f21ef5860d0>, body: {"keypair": {"name": "tempest-keypair-2001380228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/7RDgFSAhTwAKsQGD4Feqx8XiNv5N/WDFqSkMeIfZqHIZJJZjZUSfk9F1xu6jHgFoSFxSXDdGS78MAZ2RlJWKkDz8jLwyrcEHe9DAffoLQE2DhfwizQynZbWG6+Gooyw=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:20.545814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-77652171-3ee8-45b8-83e5-e5f49ca9da77 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.546438 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-77652171-3ee8-45b8-83e5-e5f49ca9da77 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:20.617955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-b1e7d278-1c11-4035-89a0-44253110f0b5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for project 873857d11992429d8f3a064665c1fc3e. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:20.678199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-b1e7d278-1c11-4035-89a0-44253110f0b5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for user b511b8f2ba394fa9b276f76a52247184 and project 873857d11992429d8f3a064665c1fc3e. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:20.806365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b1e7d278-1c11-4035-89a0-44253110f0b5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.559404 Jun 20 06:11:20.812645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 13/25] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:11:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:20.822257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-73c1ebff-6d59-479d-966e-bb67693a9eba tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef580430>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:20.839687 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-77652171-3ee8-45b8-83e5-e5f49ca9da77 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:20.874362 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-77652171-3ee8-45b8-83e5-e5f49ca9da77 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1215 microversion: 2.1 time: 0.334274 Jun 20 06:11:20.874953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1215 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:20.975099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-73c1ebff-6d59-479d-966e-bb67693a9eba tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] HTTP exception thrown: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-73c1ebff-6d59-479d-966e-bb67693a9eba tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Request method failure captured: Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c HTTP/1.1 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA92rRn_pqt4KAGifh5FVYrLYf2eZkgA58Dig5_D6NrAJwEHtNKNbxNrGtceDOGC0DeZrmu5DUgOmaOaxFuKqZP6LQWp1UqKP4VySFidvGepeQK0MzwJM9wuBR5CF912gxCFfKbFP6rWbm7XDiXrEUnA7KFVhDJTvq_N_eASTZtyV58 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:11:20.979567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}] Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 90233eaed7c24bfca8e83f6e0f66c950 Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '5ef609e3-e90e-40cb-af84-eeb8dec0a06c'} Jun 20 06:11:20.981221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. (HTTP 404) (Request-ID: req-2a46b2ee-7d9d-45bf-b301-2c84cb3f8161) Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:20.982321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:20.983769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:20.985510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-73c1ebff-6d59-479d-966e-bb67693a9eba tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Returning 404 to user: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-73c1ebff-6d59-479d-966e-bb67693a9eba tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 404 len: 109 microversion: 2.1 time: 0.167234 Jun 20 06:11:20.988451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 14/27] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:20 2022] GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:21.001385 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5716db83-253b-48a9-925e-bb62b8adba04 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ee4b5ca0>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.082926 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-5716db83-253b-48a9-925e-bb62b8adba04 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] HTTP exception thrown: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5716db83-253b-48a9-925e-bb62b8adba04 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Request method failure captured: Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: DELETE /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c HTTP/1.1 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA92rRn_pqt4KAGifh5FVYrLYf2eZkgA58Dig5_D6NrAJwEHtNKNbxNrGtceDOGC0DeZrmu5DUgOmaOaxFuKqZP6LQWp1UqKP4VySFidvGepeQK0MzwJM9wuBR5CF912gxCFfKbFP6rWbm7XDiXrEUnA7KFVhDJTvq_N_eASTZtyV58 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:11:21.085909 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}] Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 90233eaed7c24bfca8e83f6e0f66c950 Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': '5ef609e3-e90e-40cb-af84-eeb8dec0a06c'} Jun 20 06:11:21.086963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. (HTTP 404) (Request-ID: req-45f4ff6f-ab3f-4db0-a334-53fad8cba554) Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.088044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:11:21.088973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:11:21.090281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.091165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.094650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5716db83-253b-48a9-925e-bb62b8adba04 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Returning 404 to user: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:21.095843 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5716db83-253b-48a9-925e-bb62b8adba04 tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 404 len: 109 microversion: 2.1 time: 0.101409 Jun 20 06:11:21.096600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:11:20 2022] DELETE /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 109 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:11:21.106789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d76d71ae-b17b-433b-b96f-13f48b0d061c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Calling method '.version_select at 0x7f21ef63ae50>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.209092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-d76d71ae-b17b-433b-b96f-13f48b0d061c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] HTTP exception thrown: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d76d71ae-b17b-433b-b96f-13f48b0d061c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Request method failure captured: Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c HTTP/1.1 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA92rRn_pqt4KAGifh5FVYrLYf2eZkgA58Dig5_D6NrAJwEHtNKNbxNrGtceDOGC0DeZrmu5DUgOmaOaxFuKqZP6LQWp1UqKP4VySFidvGepeQK0MzwJM9wuBR5CF912gxCFfKbFP6rWbm7XDiXrEUnA7KFVhDJTvq_N_eASTZtyV58 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:11:21.211513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7782a6af4a7c4b0da1fa667510e62c45"}]}] Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7782a6af4a7c4b0da1fa667510e62c45 Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-745531773 Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 90233eaed7c24bfca8e83f6e0f66c950 Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesSnapshotsTestJSON-745531773-project Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '5ef609e3-e90e-40cb-af84-eeb8dec0a06c'} Jun 20 06:11:21.212820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. (HTTP 404) (Request-ID: req-510d2540-9d2c-4e5b-bbca-8e8d05928670) Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.213750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:11:21.214708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:11:21.215632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d76d71ae-b17b-433b-b96f-13f48b0d061c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] Returning 404 to user: Volume 5ef609e3-e90e-40cb-af84-eeb8dec0a06c could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d76d71ae-b17b-433b-b96f-13f48b0d061c tempest-VolumesSnapshotsTestJSON-745531773 tempest-VolumesSnapshotsTestJSON-745531773-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c" status: 404 len: 109 microversion: 2.1 time: 0.113060 Jun 20 06:11:21.216566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 15/29] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/os-volumes/5ef609e3-e90e-40cb-af84-eeb8dec0a06c => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:11:21.894772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:21.895462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:21.917245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.920013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:21.924904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:21.927627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:22.609450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:22.621371 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-535179179", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:22.637291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4b001df9-d382-4700-bc21-fa97a91ab668 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1219 microversion: 2.1 time: 0.745447 Jun 20 06:11:22.639481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 16/30] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:21 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1219 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:22.793252 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.network.neutron [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] validate_networks() for [('8b635499-8a2a-42bc-ac0e-c70a56c04e1f', None, None, None, None, None)] {{(pid=117586) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:23.654077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:23.655506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:23.674841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.675808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:23.676820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:23.677422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:24.181198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:24.197008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-63e8a6f1-8939-42d5-9cbf-44afce6f7faa tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1285 microversion: 2.1 time: 0.545570 Jun 20 06:11:24.199541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 17/31] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:23 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1285 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:24.817531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f85c6ce8-4323-49c2-825d-10f48358dd50 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: .version_select at 0x7f21eec800d0>, body: {"keypair": {"name": "tempest-keypair-762718235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKuD2nSYDaSrjZcZUCtYuFl0L2QKJPxosaqRY9tOms1mcW65f6mvkuQlW84QaawtDL0XeHzL4icm81hiEK2sosIN7sDVNPKZn+Htt1DbAxOFgsPL8LIq9bTvvc0WAlRCw=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:24.855508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-f85c6ce8-4323-49c2-825d-10f48358dd50 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:24.868368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-f85c6ce8-4323-49c2-825d-10f48358dd50 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:24.925842 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f85c6ce8-4323-49c2-825d-10f48358dd50 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.647717 Jun 20 06:11:24.927077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 18/32] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:11:24 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:25.227994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:25.229006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:25.243071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.256882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.258065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:25.258543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:25.635893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:25.657210 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eb93f569-8ece-43f2-9dbe-c0dea0ea366e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1273 microversion: 2.1 time: 0.439448 Jun 20 06:11:25.659002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 19/33] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:25 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1273 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:26.579606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:26.580256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:26.580785 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:26.581292 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:26.582058 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:26.607416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.607889 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.608720 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.614657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.676517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:26.677361 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:26.689946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:26.716217 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for user e1516d2903414b7caf082c32dcdac3eb and project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:26.730313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.731186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.732042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:26.732494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:26.758678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Going to run 1 instances... {{(pid=117586) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:26.766875 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:26.888680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-268454e3-d1db-4bf3-890a-476c35091d81 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.391164 Jun 20 06:11:26.889761 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 15/34] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 5394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:11:26.900125 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7f85e24f-ed1b-4478-bcb6-22b819df440c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:26.904463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7f85e24f-ed1b-4478-bcb6-22b819df440c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:27.490627 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7f85e24f-ed1b-4478-bcb6-22b819df440c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:27.505860 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7f85e24f-ed1b-4478-bcb6-22b819df440c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1221 microversion: 2.1 time: 0.607285 Jun 20 06:11:27.520728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:27.521155 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 16/35] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:26 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1221 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:27.526333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d9926692-9df7-43da-add1-02810e851640 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1273 microversion: 2.1 time: 0.850873 Jun 20 06:11:27.532594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 20/36] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:26 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1273 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:27.733522 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1621267083", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:27.985513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.network.neutron [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] validate_networks() for [('8b635499-8a2a-42bc-ac0e-c70a56c04e1f', None, None, None, None, None)] {{(pid=117586) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:28.554023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:28.554856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:28.590695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.591411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:28.597865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:28.599815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:30.985361 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:31.003202 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-496bf6df-3050-4c0d-9be0-dd4ba8cd7f62 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 2.459288 Jun 20 06:11:31.004509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 21/37] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:28 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 2461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:31.021198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-262050562", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ff1f54-998c-40b7-bb8d-98d84313c769"}], "security_groups": [{"name": "tempest-securitygroup--368394661"}], "key_name": "tempest-keypair-2001380228", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:31.672027 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:31.672471 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:31.672964 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:31.673388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:31.674487 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:31.697197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.697669 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.698494 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:31.698986 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:31.801383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] validate_networks() for [('c8ff1f54-998c-40b7-bb8d-98d84313c769', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:31.838183 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:31.848447 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for user e1516d2903414b7caf082c32dcdac3eb and project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:31.897735 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Going to run 1 instances... {{(pid=117586) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:31.900085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:32.095867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-231cc506-26a0-46ce-98bd-fe739bb37d08 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.366755 Jun 20 06:11:32.106224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 17/38] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 4378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:32.118612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:32.119254 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:32.149074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.150419 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:32.154539 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:32.155404 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:33.664936 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:33.695321 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-36f2c2ab-09a4-4f24-9dfb-07ce32f0a66c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 1.581689 Jun 20 06:11:33.696195 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 18/39] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:32 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 1589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:33.724212 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:33.726914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:33.745023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:33.745813 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:33.746861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:33.747918 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:34.141478 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:34.149599 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-34cd44c2-fd0e-4fe7-ad8a-71f2496d7658 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1274 microversion: 2.1 time: 0.451147 Jun 20 06:11:34.152810 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 19/40] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:33 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1274 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:34.171197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-680020871", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8541f83-01e2-4596-9c3d-ab5f0b6a08b8"}], "security_groups": [{"name": "tempest-securitygroup--226704315"}], "key_name": "tempest-keypair-973815044", "user_data": "}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:34.890463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=10 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:35.312451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.network.neutron [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] validate_networks() for [('b8541f83-01e2-4596-9c3d-ab5f0b6a08b8', None, None, None, None, None)] {{(pid=117586) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:36.039563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:36.040252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:36.052490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:36.053401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:36.054089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:36.078127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.078865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.080438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.081158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.146935 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for project 873857d11992429d8f3a064665c1fc3e. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:36.161225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for user b511b8f2ba394fa9b276f76a52247184 and project 873857d11992429d8f3a064665c1fc3e. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:36.204118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:36.211109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:36.427318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-52289bef-605d-4822-9793-ca70efc17551 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.421106 Jun 20 06:11:36.428627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 22/41] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 5423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:36.440758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:36.451538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:36.507412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.510856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:36.515349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:36.519716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:37.466115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:37.484441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-da3edf43-904c-4679-9ac0-eae69cecf8e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 1.054321 Jun 20 06:11:37.488224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 23/42] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:36 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:37.520440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-160569431", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e482afaf-8e11-49aa-a25e-27526ac7158f"}], "security_groups": [{"name": "tempest-securitygroup--60277450"}], "key_name": "tempest-keypair-762718235", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:38.571659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] validate_networks() for [('e482afaf-8e11-49aa-a25e-27526ac7158f', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:11:39.270053 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Flavor limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:39.270737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Image limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:39.271035 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Flavor pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:39.271810 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Image pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:39.272656 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:39.304461 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.306766 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.308037 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.311657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.366165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:39.393304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for user 498822fcffaf4cc79532c487418cb11c and project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:39.463892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Going to run 1 instances... {{(pid=117586) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:39.482399 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:39.779278 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-08f3df35-1ef5-4a24-ac5d-9f474a11d8dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 5.624815 Jun 20 06:11:39.793297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 20/43] 10.222.0.39 () {62 vars in 1187 bytes} [Mon Jun 20 06:11:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 5639 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 20 06:11:39.817097 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:39.834583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:39.866850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.869566 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:39.877504 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:39.879552 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.958309 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:41.967234 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-43da3f84-67f3-4e96-8644-48d060305685 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1280 microversion: 2.1 time: 2.171481 Jun 20 06:11:41.968469 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 21/44] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:39 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1280 bytes in 2174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:41.976343 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:41.980093 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:41.991605 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.993179 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:41.994334 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:41.995113 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.331304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:42.342564 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9dd83e93-fe29-405a-9061-e44b2fc098dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1295 microversion: 2.1 time: 0.372690 Jun 20 06:11:42.348401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 22/45] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:41 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1295 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:42.652838 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-532c5a4e-11aa-4763-a634-e2a2665e90a6 req-e6fa314b-99d2-4a94-b19b-0799cbc48a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d50c90f0-0a14-4140-a77a-4a13f3011517", "tag": "d09a8a67-811d-4da5-90e8-a7424f4f3d1a"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:42.681478 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-532c5a4e-11aa-4763-a634-e2a2665e90a6 req-e6fa314b-99d2-4a94-b19b-0799cbc48a9b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.681890 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-532c5a4e-11aa-4763-a634-e2a2665e90a6 req-e6fa314b-99d2-4a94-b19b-0799cbc48a9b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.714412 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-532c5a4e-11aa-4763-a634-e2a2665e90a6 req-e6fa314b-99d2-4a94-b19b-0799cbc48a9b service nova] Creating event network-changed:d09a8a67-811d-4da5-90e8-a7424f4f3d1a for instance d50c90f0-0a14-4140-a77a-4a13f3011517 on hv-cinder-80403 Jun 20 06:11:42.715029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-532c5a4e-11aa-4763-a634-e2a2665e90a6 req-e6fa314b-99d2-4a94-b19b-0799cbc48a9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:11:42.717063 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.717926 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.718907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.719456 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.730912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.compute.rpcapi [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:11:42.732035 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] Releasing lock "compute-rpcapi-router" {{(pid=117586) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:11:42.743474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:11:42.748062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:11:42.750838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:11:42.751740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:11:42.752682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:11:42.765599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.766060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.768042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.769993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.771487 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f6093743-44e3-4832-b8c6-b36db42f9ee1 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.421545 Jun 20 06:11:42.773434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 23/46] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:42.784801 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:42.786171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:42.788526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:11:42.793188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:11:42.794370 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.794834 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.795767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.796408 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.808457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:11:42.810942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:11:42.899422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e9cc4ce3-6cac-4144-a0c7-77a0720c3bd2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 5.404466 Jun 20 06:11:42.900620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 24/47] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:11:37 2022] POST /compute/v2.1/servers => generated 400 bytes in 5407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:11:42.906566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:42.907563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:42.918108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.918825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:42.919952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:42.920606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.018262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.029805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.031755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.033260 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.034014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-968de2ef-0ad0-42ae-9c29-a1296781b659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1332 microversion: 2.20 time: 0.131319 Jun 20 06:11:43.036433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 25/48] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:42 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1332 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:43.041676 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-73affcff-bb46-4941-aeb0-65f035d5b883 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.266658 Jun 20 06:11:43.042708 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 24/49] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:42 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.047675 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-08b0762a-b6fb-4ea3-a171-6a3f420a9857 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:43.048323 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-08b0762a-b6fb-4ea3-a171-6a3f420a9857 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:43.051322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:43.144511 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-08b0762a-b6fb-4ea3-a171-6a3f420a9857 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.153130 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-08b0762a-b6fb-4ea3-a171-6a3f420a9857 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1240 microversion: 2.1 time: 0.109274 Jun 20 06:11:43.153716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 25/50] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:43 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1240 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.158794 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:43.178348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:43.200580 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.202775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.211115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.223156 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.256002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-23eacc1f-83d7-4ef7-b56f-104482936c99 req-c08b8700-ecdc-497f-a39c-b352bd8af045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba092673-d9fc-41fc-8951-70d3ece80024", "tag": "2576bc04-b00f-4cc8-b5d6-fee542d47216"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:43.278472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-23eacc1f-83d7-4ef7-b56f-104482936c99 req-c08b8700-ecdc-497f-a39c-b352bd8af045 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.279259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-23eacc1f-83d7-4ef7-b56f-104482936c99 req-c08b8700-ecdc-497f-a39c-b352bd8af045 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.321574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-23eacc1f-83d7-4ef7-b56f-104482936c99 req-c08b8700-ecdc-497f-a39c-b352bd8af045 service nova] Creating event network-changed:2576bc04-b00f-4cc8-b5d6-fee542d47216 for instance ba092673-d9fc-41fc-8951-70d3ece80024 on hv-cinder-80403 Jun 20 06:11:43.322114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-23eacc1f-83d7-4ef7-b56f-104482936c99 req-c08b8700-ecdc-497f-a39c-b352bd8af045 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 20 06:11:43.333351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.333812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.334629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.335074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.366471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.compute.rpcapi [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 20 06:11:43.366471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] Releasing lock "compute-rpcapi-router" {{(pid=117585) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 20 06:11:43.401511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-beac91e5-82d1-43b5-bf96-bd99a2fbfbf0 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.363183 Jun 20 06:11:43.402504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 26/51] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:43.411636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:43.412366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:43.441247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.447473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.448759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:43.449471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:43.587217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.602957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:43.608372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-69ff7a76-fd27-4089-8abb-d83c0ccefba6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1295 microversion: 2.1 time: 0.191413 Jun 20 06:11:43.617998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 27/52] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:43 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1295 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:43.620739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bb4407cb-78fa-4e15-9f94-a5849ab83618 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.465928 Jun 20 06:11:43.621618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 26/53] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:43 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:44.054317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.054970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.059144 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.059912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.061972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.063084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.064498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.065127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.068378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.069070 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.070064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.070514 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.154802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.163605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.165480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.176342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a75ffa4c-2f0d-4cc4-a5ee-fce5eac58c34 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1332 microversion: 2.20 time: 0.125298 Jun 20 06:11:44.177244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 28/54] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1332 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:44.193825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.194564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.201039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.201705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.202656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.203102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.238422 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.245944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7fb2ee08-a927-4aa6-bde8-8817847623c2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.190907 Jun 20 06:11:44.246724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 27/55] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:44.274899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.284650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6d61d2a5-ffba-4b53-8530-232c5db59b22 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1244 microversion: 2.1 time: 0.095194 Jun 20 06:11:44.285495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 29/56] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1244 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:44.625686 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.626321 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.634451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.635134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.636272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.636934 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.638707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:44.639508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:44.641501 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=55 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:44.651276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.651703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.652497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:44.657524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:44.711268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.722662 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-356a1815-5465-466d-9895-cc8555b3439a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1295 microversion: 2.1 time: 0.100845 Jun 20 06:11:44.723366 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 28/57] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:44.825420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:44.832511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b9c49385-3270-4880-ac43-7975e9046987 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.198092 Jun 20 06:11:44.833482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 30/58] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:44 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:45.195761 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.196202 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.201985 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.202453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.203230 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.203709 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.263781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.265167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.272309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.273070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.274086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.274908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.292380 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.306010 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.308053 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.310026 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0ba12bf3-ff1f-4a5e-b86c-70e757fad9e7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1332 microversion: 2.20 time: 0.118778 Jun 20 06:11:45.311507 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 29/59] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1332 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:45.317479 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.318378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.327773 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.328570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.330702 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.331676 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.412439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.420025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c3c5a076-02a8-4f43-942e-db01f65d890d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1244 microversion: 2.1 time: 0.107257 Jun 20 06:11:45.420612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 30/60] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1244 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:45.608073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:45.619888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eb129fe1-b1b7-4a13-852a-6897f15a125b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.360024 Jun 20 06:11:45.621328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 31/61] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:45.740313 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.741258 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.767051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.767782 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.770668 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.771397 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.850705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:45.851701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:45.854025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=8 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:45.862066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.869230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.870472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:45.875987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:45.885615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=81 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:46.006986 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.017876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8bbea7f8-e155-4779-bfa0-cbfdfb7689b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1295 microversion: 2.1 time: 0.281703 Jun 20 06:11:46.018811 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 31/62] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1295 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:46.318937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.330133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-92c9d173-ec24-48f7-b0f1-bb66c29796b0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.483150 Jun 20 06:11:46.330377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:46.330952 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:46.337843 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.338597 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.339677 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.339798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:45 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:46.340393 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.437853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:46.439283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:46.450853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.454048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.456071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.456789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.461602 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.471424 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.473329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.474850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-769bea62-dd5f-4d59-a94e-73dcbeccb1e8 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.148860 Jun 20 06:11:46.475754 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 32/64] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:46 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:46.562662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.571357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2e4ddbcf-6cdb-42cb-b6cb-131ef13048b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.138529 Jun 20 06:11:46.571991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 33/65] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:46 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:46.639525 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:46.640179 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:46.647827 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.648229 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.649026 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:46.649805 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:46.977500 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:46.987685 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5636ea0c-3e02-40a3-a782-2f0584ce54ac tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.352467 Jun 20 06:11:46.988503 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 33/66] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:46 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:47.036077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.036668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.043662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.044206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.045221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.046120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.300598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.309716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d8e69fb4-4f1b-4517-b21a-ae22b21c47a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1295 microversion: 2.1 time: 0.278536 Jun 20 06:11:47.310663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 34/67] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1295 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:47.348265 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.356726 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.369110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.370943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.379435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-7ff64b9d-3252-4b65-81de-078f043de1d0 req-0d4b033d-e381-41a0-b0fb-86f3b5bbbcae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a56a8cd9-74e7-4fa3-8423-12112a7321b7", "tag": "335f3da0-2be8-4179-92bc-ba0c3c29d492"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:47.382034 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.382509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.420229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-7ff64b9d-3252-4b65-81de-078f043de1d0 req-0d4b033d-e381-41a0-b0fb-86f3b5bbbcae service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.421311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-7ff64b9d-3252-4b65-81de-078f043de1d0 req-0d4b033d-e381-41a0-b0fb-86f3b5bbbcae service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.437082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-7ff64b9d-3252-4b65-81de-078f043de1d0 req-0d4b033d-e381-41a0-b0fb-86f3b5bbbcae service nova] Creating event network-changed:335f3da0-2be8-4179-92bc-ba0c3c29d492 for instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 on hv-cinder-80403 Jun 20 06:11:47.457883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-7ff64b9d-3252-4b65-81de-078f043de1d0 req-0d4b033d-e381-41a0-b0fb-86f3b5bbbcae service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084306 Jun 20 06:11:47.459049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 35/68] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:11:47.500363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.501569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.517310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.517776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.518753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.519746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.632244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.642486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.644726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.646086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-55eb982f-01e6-451d-8643-a13cc425a17e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.155782 Jun 20 06:11:47.658998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 36/69] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:47.664548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:47.665581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:47.670329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.678329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.679275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.679463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9cccd184-e9fa-458e-a13a-a7c239e62e26 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.336345 Jun 20 06:11:47.680428 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 34/70] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:47.680591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:47.681252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:47.753870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:47.761940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3115bc87-0aca-4427-a4ac-c4238efe6fb1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.101598 Jun 20 06:11:47.762588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 37/71] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:47 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.006613 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.007456 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.015341 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.016216 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.018286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.018914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.266392 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.274460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6c36ad3a-7a8a-4dd4-b36b-95aa6fb32f25 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.272510 Jun 20 06:11:48.275043 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 35/72] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.327341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.327965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.334482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.334958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.335715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.336156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.510160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.518971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8e24cb39-b693-47df-ae24-4d8f512f87b8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.195114 Jun 20 06:11:48.519560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 38/73] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.668733 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.669384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.675985 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.676452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.677298 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.677742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.699026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.700764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.712059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.713593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.715899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.716747 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.756743 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.766836 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.771144 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.773077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-42333c93-b3e6-47cb-a384-5bceaba7ee99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.111068 Jun 20 06:11:48.774251 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 36/74] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:48.789727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:48.790530 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:48.797460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.798610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.799566 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:48.800161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:48.891440 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.903924 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b19958f4-b46d-4a42-82dd-7fff755f1665 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.117785 Jun 20 06:11:48.904528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 37/75] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:48.942448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:48.949879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9196ed88-8273-474b-b286-98e6a408d751 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.258407 Jun 20 06:11:48.950448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 39/76] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:48 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:49.293612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.294346 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.300807 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.301342 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.302183 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.302724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.441684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.455299 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9887f15b-b6c1-45ff-8fb2-60e67ff476db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.165257 Jun 20 06:11:49.456458 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 38/77] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:49.537528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.538330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.544276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.544764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.545538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.545984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.677793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.688660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c31066a9-6d1f-4234-8593-bb778088dd61 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.154794 Jun 20 06:11:49.690742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 40/78] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:49.796469 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.797390 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.805336 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.805797 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.806590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.807031 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.875965 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.885213 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.887128 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:49.888227 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b0b6376c-4ef9-4ae0-9cb8-8655c84586bb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.099228 Jun 20 06:11:49.888962 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 39/79] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:49.924066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.925180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.931619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.932080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.932895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.933346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.967844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:49.968464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:49.975808 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.976510 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.978095 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:49.978784 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:49.999836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.008931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf95e958-0723-4e10-a49e-fbabf3978f21 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.090404 Jun 20 06:11:50.018496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 41/80] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.119558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.130172 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5293d284-fce4-4ee7-858f-6a11c93405d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.166644 Jun 20 06:11:50.130981 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 40/81] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:49 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:50.472996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.473608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.479611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.480062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.480859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.481306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.613663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.621112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6184526c-844d-49c2-aa46-e72e4b1c3ac4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.152483 Jun 20 06:11:50.621694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 42/82] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.707955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.708556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.714649 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.715108 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.715880 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.716324 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.850344 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.861099 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-da141b71-39c6-431d-8248-1f08f5e734b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.157034 Jun 20 06:11:50.861907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 41/83] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:50.906323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:50.906933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:50.913968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.914426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.915306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:50.915817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:50.978814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.987110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.988614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:50.989743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cb87a706-8322-456b-ae0b-fea867921caa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.087398 Jun 20 06:11:50.990300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 43/84] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:50 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:51.025415 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.026061 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.032152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.033386 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.034403 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.035039 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.103526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:51.115721 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4b7e9585-7389-4290-b32c-0b57e395ce51 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.094149 Jun 20 06:11:51.116293 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 42/85] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:51.146343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.146954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.152934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.153391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.154151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.154918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.295797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:51.304354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2345b60b-cd5b-4d22-b7a8-1f26552c7c61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.161791 Jun 20 06:11:51.304951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 44/86] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:51.640189 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.641955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.652133 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.652848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.654074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.654650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.796903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:51.805606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e24aa0ec-a33c-45fc-8bdb-51dc04fb112b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.170997 Jun 20 06:11:51.806200 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 43/87] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:51.880430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:51.881065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:51.887629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.888078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:51.888869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:51.889308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.008013 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.008561 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.015137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.016137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.017093 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.017544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.023972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.031416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dd12132f-3d85-4838-842e-612a35b29dc1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.155831 Jun 20 06:11:52.031984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 45/88] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:51 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:52.081311 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.083980 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:52.091190 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.092694 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.093813 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5ac6c403-3e3c-42d9-9699-b7621b1bcc57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.089824 Jun 20 06:11:52.094371 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 44/89] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:52.135391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.135961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.142317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.142812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.143579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.144018 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.204265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.211665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1d8b019e-e870-4a72-bfb1-439bf0ffe1de tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.080224 Jun 20 06:11:52.212234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 46/90] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:52.320926 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.321484 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.328028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.328544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.330194 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.331044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.469024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.478177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d1c0d692-779b-46f6-881d-dd05affffe04 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.161192 Jun 20 06:11:52.478756 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 45/91] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:52.823865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:52.824585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:52.827069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=12 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:52.833459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.833922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.834702 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:52.835172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:52.980768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:52.988520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7a576174-2596-430c-b213-7ac797a8e7bc tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.169114 Jun 20 06:11:52.989136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 47/92] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:52 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:53.048981 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.049607 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.051494 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=10 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:53.056941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.057408 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.058176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.058624 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.113462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.114080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.120067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.120769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.121799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.122242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.149775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=34 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:53.199957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.207832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.209392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.210501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-234bd7e3-c3ac-408a-a437-47ba2e7a988b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.101771 Jun 20 06:11:53.211063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 48/93] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:11:53.216570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.224077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6bd34e21-aadf-44d3-8609-674d93a779ea tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.178936 Jun 20 06:11:53.224644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 46/94] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:53.228898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.229511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.235413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.236356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.237589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.238033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.253286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:53.303316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.310751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b873e46d-1a38-4867-8167-63f97b7bd01f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.085622 Jun 20 06:11:53.311333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 49/95] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:53.495379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:53.496006 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:53.502197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.503246 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.504011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:53.504453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:53.639565 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:53.647154 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b00f3cc3-7bb7-4200-beda-da5c41b0c7c0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.155711 Jun 20 06:11:53.647737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 47/96] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:53 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.006817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.007438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.009316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:54.014670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.015129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.015901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.016353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.148346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.162979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-74507791-4c9f-4cfc-81a8-eb4cd6d7432e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.161487 Jun 20 06:11:54.163567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 50/97] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.228636 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.229280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.235311 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.235777 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.236855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.237375 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.243132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.243751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.249667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.250127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.250898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.251342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.301984 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.310842 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.312688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.313959 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a5e98cd0-cf01-49e1-804b-9d1d9409b585 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.089176 Jun 20 06:11:54.316062 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 48/98] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:54.328530 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.329508 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.336166 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.336721 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.337595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.338106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.409744 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.417080 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-eef9e593-c8d4-49f5-9ac7-22a3baf00b48 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.092244 Jun 20 06:11:54.417850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 49/99] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:54.426643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.433951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-727ea558-4ce6-47ae-a56f-e56f18c45616 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.197141 Jun 20 06:11:54.434507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 51/100] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:54.664303 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:54.664865 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:54.671137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.671600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.672377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:54.672860 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:54.805348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:54.812643 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a1d5b2fb-ec1b-4346-8f5e-e83b31ef04e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.152260 Jun 20 06:11:54.813230 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 50/101] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:54 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.181244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.181863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.187886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.188344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.189138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.189588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.317433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.324844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-75d693d8-35bf-442b-b5ad-bda2d0a1952e tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.147429 Jun 20 06:11:55.325421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 52/102] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.331348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.331964 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.338206 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.338664 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.339433 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.339873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.404623 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.413198 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.414713 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.415815 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5d10ab28-f5ca-40f4-a416-4403153137b7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.088485 Jun 20 06:11:55.416365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 51/103] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:55.433888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.434782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.440727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.441182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.441945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.442384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.452021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.452641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.459107 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.459570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.460341 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.460803 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.507845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.515412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-512158a8-4e22-4ca2-bce7-d2ea45e2fce9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.085284 Jun 20 06:11:55.515990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 53/104] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:55.600143 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.607495 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4abb3edc-475a-4e27-b017-1b71f7abcb57 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.159221 Jun 20 06:11:55.608067 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 52/105] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:55.831446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:55.832074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:55.838127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.838590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.839371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:55.839822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:55.974571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:55.982028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f91c6362-7227-48a7-94c4-331a78ecc01a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.155284 Jun 20 06:11:55.982589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 54/106] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:55 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:56.340918 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.341477 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.347891 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.348359 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.349181 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.349633 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.437252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.438208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.446021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.446686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.447725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.448405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.484105 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.492798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d008b0ce-3283-4391-987f-4b26a1a7582a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.155830 Jun 20 06:11:56.493380 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 53/107] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:56.514733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.523800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.525367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.526553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f2dbe649-6f10-4846-b029-7f72c4637378 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.094861 Jun 20 06:11:56.527095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 55/108] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:56.531728 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.532347 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.539391 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.539850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.540614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.541091 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.605397 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.613297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b73f95e1-9a98-49ea-af95-b496327ba9d8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1292 microversion: 2.1 time: 0.085422 Jun 20 06:11:56.613868 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 54/109] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:56.624917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.625586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:56.631817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.632284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.633063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:56.633504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:56.768487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:56.775878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5483a91f-0816-4adb-b34d-fa934325346a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.154819 Jun 20 06:11:56.776442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 56/110] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:56.998865 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:56.999622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.006900 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.007361 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.008148 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.008594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.141360 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.149627 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-dfa8d464-3d0b-4969-b06a-0af796eff6f7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.154638 Jun 20 06:11:57.151280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 55/111] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:56 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.510249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.511016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.517390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.517896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.518685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.519136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.545342 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.545963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.553614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.554294 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.555226 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.555824 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.627675 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.635756 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.637286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.638573 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-dd5019bb-3165-4c08-851b-c107d35b68fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1338 microversion: 2.20 time: 0.097102 Jun 20 06:11:57.639126 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 56/112] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1338 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:57.646103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.647610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.654595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.655267 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.656045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.656486 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.695678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.703493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0acd111e-bea2-4fd8-a609-a546fa7c8205 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.197622 Jun 20 06:11:57.704293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 57/113] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.728882 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.737978 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-51739f63-fa97-4867-9769-1dda00bb3767 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.096563 Jun 20 06:11:57.738571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:57.794072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:57.794689 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:57.802277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.802762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.803540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:57.804033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:57.967522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:57.979330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5cbbfa5e-fb2f-4878-b141-0241f193416f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.189059 Jun 20 06:11:57.980247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 58/115] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:57 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.167727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.168590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.176140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.177168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.178179 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.178633 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.338604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.366060 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1cb907fe-29b9-4729-b82c-980683a244ec tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.202320 Jun 20 06:11:58.375245 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 58/116] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.656153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.656829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.663458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.663917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.664692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.665214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.769154 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-3256379b-4e74-4fd3-a11b-31d6607e6f2d req-e7940c13-6c99-45e4-acbe-9263a02af948 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba092673-d9fc-41fc-8951-70d3ece80024", "name": "network-vif-plugged", "status": "completed", "tag": "2576bc04-b00f-4cc8-b5d6-fee542d47216"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:11:58.778445 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-3256379b-4e74-4fd3-a11b-31d6607e6f2d req-e7940c13-6c99-45e4-acbe-9263a02af948 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.779155 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-3256379b-4e74-4fd3-a11b-31d6607e6f2d req-e7940c13-6c99-45e4-acbe-9263a02af948 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.792033 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-3256379b-4e74-4fd3-a11b-31d6607e6f2d req-e7940c13-6c99-45e4-acbe-9263a02af948 service nova] Creating event network-vif-plugged:2576bc04-b00f-4cc8-b5d6-fee542d47216 for instance ba092673-d9fc-41fc-8951-70d3ece80024 on hv-cinder-80403 Jun 20 06:11:58.799145 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-3256379b-4e74-4fd3-a11b-31d6607e6f2d req-e7940c13-6c99-45e4-acbe-9263a02af948 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095118 Jun 20 06:11:58.799145 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 59/117] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:11:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:11:58.805237 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.808850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.809043 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.815940 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.816395 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.817279 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.817616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.817776 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.819189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.820268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b3d02fcb-eb6e-40d9-b791-b4d0ac715885 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.168097 Jun 20 06:11:58.820863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 59/118] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:11:58.825278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.825886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:58.834477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.835255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.836518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:58.837008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:58.923815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.931832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3951e3d7-a493-4ad2-8a6b-21c56513c2d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.109969 Jun 20 06:11:58.932534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 60/119] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.983832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:58.992330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-37d18973-e3c0-4adf-980e-1f09aec87e37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.192614 Jun 20 06:11:58.992956 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 60/120] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:11:58.995996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:58.996614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.003070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.003595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.004382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.004891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.141135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.150138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b7edb651-c7b3-4e9e-9fd9-2534b31e48ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.157904 Jun 20 06:11:59.150880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 61/121] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:58 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:59.383024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.383638 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.389663 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.390119 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.390881 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.391319 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.522132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.529563 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4406db56-131b-4d8a-946f-f280e03c5fd5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.150408 Jun 20 06:11:59.530212 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 61/122] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:11:59.838660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.839211 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.845127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.845592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.846906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.847533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.948794 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:11:59.949421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:11:59.955644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.956106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.956922 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:11:59.957368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:11:59.961636 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:11:59.979377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.988042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.989593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:11:59.990714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-08629d1b-ddd5-40aa-9fe0-bab43f5dd72d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.156097 Jun 20 06:11:59.991298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 62/123] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:00.009418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.010037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.016078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.016536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.017351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.017875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.022136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.029621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8229f7b3-be5e-465e-837d-d596ed2972ad tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.084681 Jun 20 06:12:00.030188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 62/124] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:11:59 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:00.145156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.152456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-98e5d19b-2f43-413d-b587-9e2b296af018 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.146858 Jun 20 06:12:00.153057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 63/125] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:00.166715 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.167329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.173443 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.173907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.175446 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.175891 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.304571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.311970 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-12f05418-5953-4307-989c-cc3123f0b266 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.149067 Jun 20 06:12:00.312538 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 63/126] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:00.547314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:00.547965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:00.553959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.554418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.555181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:00.555621 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:00.681442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:00.688776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-062ca14b-05c4-4890-99f5-3ae5f90f6575 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.145277 Jun 20 06:12:00.689339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 64/127] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:00 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:01.008912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.009559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.015670 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.016122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.016902 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.017343 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.046784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.047516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.054455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.054924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.055701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.056148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.137755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.145925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2bcc73ff-1d99-46cd-8b64-82e82b01ad01 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.102922 Jun 20 06:12:01.146736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 65/128] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:01.166241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.169399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.170016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.174904 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.176498 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.176989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.177450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.177655 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5ceb928c-68a3-45df-971a-53cac67e996d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.172660 Jun 20 06:12:01.178213 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 64/129] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:01.178342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.178658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.181253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:01.305846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.313169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5e44d74e-ed78-465f-ba7e-38e1b981ce9f tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.147469 Jun 20 06:12:01.313733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 66/130] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:01.328458 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.329116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.335619 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.336077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.336884 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.337328 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.466192 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.474160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-315ba187-ca20-475a-b58a-3b44bc553bd7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.149589 Jun 20 06:12:01.474746 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:01.707009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:01.707627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:01.713568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.714025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.714791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:01.715243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:01.848946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:01.857116 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-07fae385-22ec-4555-896f-7664f454dde1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.154379 Jun 20 06:12:01.857765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 67/132] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:01 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.163025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.163725 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.169914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.170376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.171148 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.171594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.195783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.196404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.202338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.202801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.203580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.204031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.232545 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.240847 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-efc16e83-8b5c-4563-8751-b63c5d63f4e5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.081860 Jun 20 06:12:02.241436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 66/133] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.330309 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.331692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.338654 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.339122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.339954 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.340565 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.345885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.353764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.355278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.356404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-12d65014-970d-428f-bfe1-fb1de13c25e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.164428 Jun 20 06:12:02.356989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 68/134] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:02.468929 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.476532 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b3c6875d-02cf-4fc2-9a4b-0dd557f4187b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.150101 Jun 20 06:12:02.477127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 67/135] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:02.491072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.491687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.497700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.498180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.498921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.499354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.625087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:02.633244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b710587-b8e1-452f-807b-46495a87ce96 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.146556 Jun 20 06:12:02.633809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 69/136] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:02.873897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:02.874510 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:02.880571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.881058 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:02.881819 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:02.882335 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.017220 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.024860 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bddb652d-2197-45f2-b18d-0d2eb0701013 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.154693 Jun 20 06:12:03.025708 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 68/137] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:02 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:03.260358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.261701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.271517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.272300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.273382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.275462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.376662 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.379085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.386307 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.386987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.387861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.388502 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.412824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:03.422774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b5942a5e-f169-4b30-80f8-308161e9d0ff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1300 microversion: 2.1 time: 0.167780 Jun 20 06:12:03.423491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 70/138] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1300 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:03.496494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:03.497144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:03.504529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.505020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:03.505812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:03.506259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.075583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.093353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.095240 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.110620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f06d1c33-9ee4-4a49-ba8a-c868b0727eb0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.727909 Jun 20 06:12:04.115679 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 69/139] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:04.129188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.129901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.149695 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.150173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.150975 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.151428 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.151663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.163821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-721e5cb6-059c-449c-b13f-8c132c0c8f63 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.673838 Jun 20 06:12:04.179777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 71/140] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:03 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:04.192613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-2a9d98b3-759d-47b9-a9a1-d1e3688a993d req-5402062b-8852-4f57-a0ca-b6db08d5bbb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:04.204378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2a9d98b3-759d-47b9-a9a1-d1e3688a993d req-5402062b-8852-4f57-a0ca-b6db08d5bbb8 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.205237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2a9d98b3-759d-47b9-a9a1-d1e3688a993d req-5402062b-8852-4f57-a0ca-b6db08d5bbb8 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.219730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-2a9d98b3-759d-47b9-a9a1-d1e3688a993d req-5402062b-8852-4f57-a0ca-b6db08d5bbb8 service nova] Creating event network-changed:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:12:04.226781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-2a9d98b3-759d-47b9-a9a1-d1e3688a993d req-5402062b-8852-4f57-a0ca-b6db08d5bbb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044217 Jun 20 06:12:04.228683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 72/141] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:04.234469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.235499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.245303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.246148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.253508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.254142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.889090 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.907928 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-763498f0-a921-4d22-9087-e6f34fe3e625 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.788815 Jun 20 06:12:04.920058 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 70/142] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:04.927741 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:04.933437 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:04.940395 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.941017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.942329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:04.943037 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:04.949065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:04.968229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-17d75d19-e610-49e3-83cb-de930ef3564a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.738061 Jun 20 06:12:04.970844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 73/143] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:05.134285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.134814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.145033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.145504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.146292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.146903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.187382 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.200945 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2ece8561-a711-497e-b927-486c3f277cd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1298 microversion: 2.1 time: 0.278344 Jun 20 06:12:05.202575 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 71/144] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:04 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1298 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:05.209839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.210744 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.217456 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.218264 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.220056 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.220864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.585612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.598100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.599633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.600838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-86fe9eb0-3144-4ae5-bd88-01dbce5e1c4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.470685 Jun 20 06:12:05.601884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 74/145] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:05.616327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-ec6b27be-1a6d-405b-9a12-c53c3de7edd4 req-251de7ff-7d7f-4562-8d7a-0afe9664df4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db62494c-25f7-4eab-8c22-5c48182d5a5a", "tag": "bfaf0961-1cb5-4edf-b383-b51c377b031f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:05.624931 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:05.643241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ec6b27be-1a6d-405b-9a12-c53c3de7edd4 req-251de7ff-7d7f-4562-8d7a-0afe9664df4e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.644362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ec6b27be-1a6d-405b-9a12-c53c3de7edd4 req-251de7ff-7d7f-4562-8d7a-0afe9664df4e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.645017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-042f6808-e7ea-4296-8ce2-80d8e21f6a35 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.441145 Jun 20 06:12:05.645876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 72/146] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:05.678102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-ec6b27be-1a6d-405b-9a12-c53c3de7edd4 req-251de7ff-7d7f-4562-8d7a-0afe9664df4e service nova] Creating event network-changed:bfaf0961-1cb5-4edf-b383-b51c377b031f for instance db62494c-25f7-4eab-8c22-5c48182d5a5a on hv-cinder-80403 Jun 20 06:12:05.689160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-ec6b27be-1a6d-405b-9a12-c53c3de7edd4 req-251de7ff-7d7f-4562-8d7a-0afe9664df4e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075524 Jun 20 06:12:05.690406 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 75/147] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:05.926823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:05.927462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:05.946074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.946544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.947331 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:05.947776 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:05.988755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.007272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.013464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.014185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.015058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.015822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.223894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.233077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f9b8b404-1939-4d04-95a6-c9eb8bceb33f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.310445 Jun 20 06:12:06.234198 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 73/148] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:06.244785 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.246543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.259703 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:06.262382 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.263244 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.264575 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.265588 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.315255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.334558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ee4f3565-fbe4-4684-be63-34c5e5e3ffdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.350208 Jun 20 06:12:06.335824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 76/149] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:05 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:06.565995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-013627d8-03e0-40d9-8f85-52486ba86007 req-65217c4d-d847-44ad-83ff-3de2370c6e8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50c90f0-0a14-4140-a77a-4a13f3011517", "name": "network-vif-plugged", "status": "completed", "tag": "d09a8a67-811d-4da5-90e8-a7424f4f3d1a"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:06.575870 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.587523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6ab21746-7a4b-4556-a212-9dd9b5842f15 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.351524 Jun 20 06:12:06.588290 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:06.588501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-013627d8-03e0-40d9-8f85-52486ba86007 req-65217c4d-d847-44ad-83ff-3de2370c6e8b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.589580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-013627d8-03e0-40d9-8f85-52486ba86007 req-65217c4d-d847-44ad-83ff-3de2370c6e8b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.602912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-013627d8-03e0-40d9-8f85-52486ba86007 req-65217c4d-d847-44ad-83ff-3de2370c6e8b service nova] Creating event network-vif-plugged:d09a8a67-811d-4da5-90e8-a7424f4f3d1a for instance d50c90f0-0a14-4140-a77a-4a13f3011517 on hv-cinder-80403 Jun 20 06:12:06.614833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-013627d8-03e0-40d9-8f85-52486ba86007 req-65217c4d-d847-44ad-83ff-3de2370c6e8b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054820 Jun 20 06:12:06.615445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 77/151] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:06.619243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.619851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.626586 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.627932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.628913 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.629504 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.664315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:06.665629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:06.673231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.675223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.676432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:06.677141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:06.818012 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.826257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.827774 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.829546 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-20b1255b-695b-4014-8c8f-23d28c9c7915 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.214614 Jun 20 06:12:06.831095 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 75/152] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:06.894221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:06.902974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bd7b9c39-2914-4bf3-ba91-c645c96c2afd tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.243254 Jun 20 06:12:06.903581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 78/153] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:06 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.261325 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.261932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.268359 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.268847 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.269605 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.270045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.357856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.358610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.365897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.366363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.367252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.367683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.415141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.422583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-dac5f046-2ea2-40a9-8bed-9d98eb21dd3e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.165126 Jun 20 06:12:07.423239 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 76/154] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.501156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.512947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-af9aa1d4-7b25-4225-8c4b-d0ccc9ed0a99 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.158789 Jun 20 06:12:07.513521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 79/155] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:07.605041 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.605647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.612276 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.612811 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.613571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.614007 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.742454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:07.749940 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b3d6c338-f0e6-416c-9fc7-8722fd19ae8d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.148655 Jun 20 06:12:07.750508 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 77/156] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:07.849562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.850177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.856357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.856832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.857594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.858031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.919873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:07.920601 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:07.926616 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.927088 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:07.927859 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:07.928310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.036614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.045558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.047115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.048232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-44c63b4a-2a25-494a-ab74-0ed9548d8c97 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.203822 Jun 20 06:12:08.048901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 80/157] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:08.082626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.084844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.091344 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c12a9b58-ab67-404f-a937-44489cefba5a tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.175306 Jun 20 06:12:08.091917 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 78/158] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:07 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:08.439282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.440585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.446817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.447362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.448142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.448582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.529684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.530357 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.536590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.537080 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.537843 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.538283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.589559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.597022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-688ee532-a1ee-4cc1-a88c-6ffb802a0b8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.161539 Jun 20 06:12:08.597584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:08.672008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.680011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7f64f9b8-765a-4877-a052-4b5f1ebcf9d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.154233 Jun 20 06:12:08.680558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:08.766677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:08.767294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:08.769698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:08.775358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.775812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.776575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:08.777046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:08.911184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:08.920650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8039498f-d901-4bc8-8e77-c9cd2bd3737e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.157747 Jun 20 06:12:08.921257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:08 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:09.066187 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.066805 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.073009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.073472 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.074236 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.074683 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.107366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.108087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.115055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.115615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.116430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.116906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.260970 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.269560 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.271164 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.272350 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-15db4b06-8b4f-4584-943a-40ec9a683998 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.210071 Jun 20 06:12:09.272946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 80/162] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:09.289564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.296952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-117cf5a7-a0fe-49c0-a466-144ffb4275a1 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.193391 Jun 20 06:12:09.297458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 83/163] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:09.614427 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.614984 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.621017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.621468 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.622224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.622661 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.698384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.699004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.705096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.706359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.706842 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.707276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.780168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.788430 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ca05a768-8121-4ba8-9802-219758696162 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.178425 Jun 20 06:12:09.789127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 81/164] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:09.842744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:09.844997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:09.851829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-35135500-88c2-4da5-ab4e-314daf20e9f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.158003 Jun 20 06:12:09.852724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 84/165] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:09.937917 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:09.938678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:09.945406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.945864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:09.946630 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:09.947105 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.078275 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.086087 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e4441636-d3ad-4433-a7c8-230e1d934e0f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.151930 Jun 20 06:12:10.086646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 82/166] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:09 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:10.289191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.289807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.295759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.296216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.297018 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.297462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.313703 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.314326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.320940 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.321379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.322139 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.322575 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.496024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.499351 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.504005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.505649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.506853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1c30c217-4662-4572-beb5-f2c25f6596de tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.221499 Jun 20 06:12:10.507335 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5c3f7f6f-1e6e-42be-85b4-8f137ab5963b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.197309 Jun 20 06:12:10.507586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 85/167] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:10.508054 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 83/168] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:10.805205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.805812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.811953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.812402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.813198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.813638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.868894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:10.869646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:10.875789 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.876250 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.877107 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:10.877556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:10.987163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:10.995774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-13d39492-5ae7-40a1-9e27-7f71f0b0b22b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.194312 Jun 20 06:12:10.996352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 86/169] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.035397 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.042855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c9ff53d7-1eeb-4394-a9ff-57d1740cb27b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.177766 Jun 20 06:12:11.043368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 84/170] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:10 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:11.102554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.103161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.109155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.109603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.110359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.110916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.240140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.247515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d886fd94-fc50-4a31-8557-741af377a544 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.148727 Jun 20 06:12:11.248071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 87/171] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.524013 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.524635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.524764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:11.525354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:11.530699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.531165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.531278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.531657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.531938 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.532386 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.532478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:11.532897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:11.727331 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.730462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.734841 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-45dcc83f-c278-4d2d-b65e-55ef8e0f3118 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.214679 Jun 20 06:12:11.735635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 85/172] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:11.739281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.740825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:11.741923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3294c823-50ca-4229-a956-2660d0a4e1d4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.221157 Jun 20 06:12:11.742479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 88/173] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:11 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:12.013000 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.013647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.020010 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.020475 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.021670 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.021761 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.058190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.058806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.065609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.066078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.066870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.067310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.201466 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.209733 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ca93362b-f90e-4708-9fec-cb0b688f77ae tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.200546 Jun 20 06:12:12.210585 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 86/174] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:12.232225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.240198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2b043e16-8d1b-47c5-84cc-f46aa2d917ed tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.185746 Jun 20 06:12:12.240786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 89/175] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:12.265379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.265983 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.273058 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.273519 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.274284 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.274719 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.410882 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.418613 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ea270e5f-929f-4870-9687-e2492f22e208 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.157158 Jun 20 06:12:12.419186 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 87/176] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:12.753189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.753931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.759674 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:12.760034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.760288 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:12.760489 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.761274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.761738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.766192 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.766650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.767415 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:12.768452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:12.975403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.978508 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.983119 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7be81321-6b5d-4d3a-b092-471c9151db03 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.234194 Jun 20 06:12:12.983765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 90/177] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:12.987253 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.988527 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:12.989646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-86461d57-c635-401a-baa0-31cec848b7c6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.233877 Jun 20 06:12:12.990199 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 88/178] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:12 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:13.227051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.227697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.235312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.235312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.235544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.235853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.258699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.259337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.269947 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.270411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.271186 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.272681 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.464789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.472615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7a1dda4f-c1c1-460d-b1b4-9a8b89235d92 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.249378 Jun 20 06:12:13.481891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.481891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:13.481891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:13.484716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.485175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.485935 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:13.486434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:13.486949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.497165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-570760c5-fb5b-4ff4-b003-42c36a3495f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.242884 Jun 20 06:12:13.500147 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 89/180] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:13.628649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:13.636503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-708b4d0f-4fb4-438d-aebb-4b272d7bd4a5 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.161880 Jun 20 06:12:13.637206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:14.000497 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.001164 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.008429 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.008932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.009604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.009730 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.010141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.010870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.018914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.019834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.020990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.021805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.323884 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.332045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4e2dac33-1bc8-4b29-8bdc-08b4a8fb5f37 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.335396 Jun 20 06:12:14.332742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 90/182] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:13 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:14.377794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.386008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.387519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.388895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1afdf419-749c-488e-a4f6-c7767839e98b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.384349 Jun 20 06:12:14.389660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 93/183] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:14.490022 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.490640 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.496654 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.497140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.498163 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.498749 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.528364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.536919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:14.566569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.568451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.569562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:14.572500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:14.982460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:14.990770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1c9d4848-7836-49f2-a933-1b240cab553c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.505022 Jun 20 06:12:14.991336 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:14.995786 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:14.996576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.002692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.003138 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.003904 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.004336 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.006776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.015757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d0452998-9bb5-495c-8378-1bb634d73c09 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.503709 Jun 20 06:12:15.026619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:15.108199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f6c7bf7e-182c-40dd-a86e-9ab4d778fd87 req-15bbdbbd-e1ba-477e-b19d-c9719677b515 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0338365-19aa-44e3-bf8b-fa704eb7ce10", "tag": "65c2764e-d3ea-45db-917a-f5e152011a84"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:15.117245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f6c7bf7e-182c-40dd-a86e-9ab4d778fd87 req-15bbdbbd-e1ba-477e-b19d-c9719677b515 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.117693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f6c7bf7e-182c-40dd-a86e-9ab4d778fd87 req-15bbdbbd-e1ba-477e-b19d-c9719677b515 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.129681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f6c7bf7e-182c-40dd-a86e-9ab4d778fd87 req-15bbdbbd-e1ba-477e-b19d-c9719677b515 service nova] Creating event network-changed:65c2764e-d3ea-45db-917a-f5e152011a84 for instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 on hv-cinder-80403 Jun 20 06:12:15.135290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f6c7bf7e-182c-40dd-a86e-9ab4d778fd87 req-15bbdbbd-e1ba-477e-b19d-c9719677b515 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030512 Jun 20 06:12:15.135900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 95/186] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:15.190288 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.198537 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0911d611-6045-4913-b02e-b46c2b6593b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.206180 Jun 20 06:12:15.199120 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 92/187] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:14 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:15.350630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.351279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.357522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.357979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.358745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.359222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.407006 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:15.407661 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:15.414327 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.414779 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.415544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:15.415981 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:15.529387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.537476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-89d93a52-cfb3-4f7e-845c-57cd27f4c353 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.192131 Jun 20 06:12:15.538057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 96/188] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:15.571544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.579411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.581611 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:15.582701 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4b62e129-1bb2-44d4-b9be-db66f6772a48 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.179602 Jun 20 06:12:15.583256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 93/189] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:15 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:16.008375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.009027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.015129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.015588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.016344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.016819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.034480 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.035103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.041100 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.041618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.042337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.042787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.209669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.216468 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.217355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-acf876e6-8ae7-43ed-b9a3-d05be5bec69a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.212783 Jun 20 06:12:16.217924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 97/190] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:16.222344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.222945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.224046 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-97944c5d-3fb8-4550-a135-704372873fae tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.194266 Jun 20 06:12:16.224780 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 94/191] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:16.228639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.229121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.229881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.230315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.356315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.364577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8c51769-0d63-426f-ac32-41cdfa8582ca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.145717 Jun 20 06:12:16.365167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 98/192] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:16.554232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.554844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.560951 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.561354 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.562119 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.562562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.577241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:16.599779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:16.600389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:16.606533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.607015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.607775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:16.608207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:16.744238 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.751876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-56ef74f8-654c-4804-9e6e-0975ce2d915c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.201419 Jun 20 06:12:16.752463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 95/193] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:16.775030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.783739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.785440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:16.786628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6e108e8c-c4c5-444e-a893-3d065745ea83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.191263 Jun 20 06:12:16.787271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 99/194] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:16 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:17.234100 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.234960 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.240595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.241344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.241919 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.242377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.243155 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.243592 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.247429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.247889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.248665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.249139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.436254 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.439155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.443775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-589ba769-6adf-4c3b-8818-a4df2a3eed2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.213590 Jun 20 06:12:17.444581 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 96/195] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.447237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b7cfdea-1044-4c09-8821-151d19c511d1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.211699 Jun 20 06:12:17.448012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 100/196] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.453907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.453907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.455957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.456409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.457264 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.457710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.599329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.606762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6065c457-e2d4-4000-8088-e7a780c7db75 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.161377 Jun 20 06:12:17.607261 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 97/197] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.769331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.769945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.776115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.776571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.777360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.777796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.803671 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:17.804278 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:17.810383 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.810828 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.811591 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:17.812030 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:17.961659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.969082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa5d6997-fc72-49b6-8d72-4eb2495d15db tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.204047 Jun 20 06:12:17.969656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 101/198] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:17.988267 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.996140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.997697 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:17.998805 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-04605f28-5dca-4ec6-81e1-5bbd2577e1a9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.198944 Jun 20 06:12:17.999365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 98/199] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:17 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:18.460326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.460994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.466401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.467005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.467117 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.467460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.468223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.468662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.472767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:18.472997 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.473453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.474373 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.474857 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.659972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.667253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-90e2d932-ea6d-4aa3-8dd6-c0ae7f1be7a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.210925 Jun 20 06:12:18.669323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 102/200] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:18.670488 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.674784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.675605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.679033 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d04596ae-5c42-476a-9f1a-7e87a83c2b0d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.216464 Jun 20 06:12:18.679600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 99/201] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:18.682351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.682815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.683577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.684014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.816962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:18.824633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6541fa4c-678f-450c-848e-8bda575155e2 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.154115 Jun 20 06:12:18.825274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 103/202] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:18.986149 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:18.986972 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:18.993038 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.993493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:18.994254 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:18.994689 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.017909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:19.018684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:19.024632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.025135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.025914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.026359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.178250 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.185572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b72b702b-a0de-44fa-9abc-c5dba31bbbfe tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.203315 Jun 20 06:12:19.186270 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 100/203] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:18 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:19.204241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.214665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.216169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:19.217298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a3f7a5a6-aba6-45e5-aa32-282074e624f1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.203840 Jun 20 06:12:19.217859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 104/204] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:19 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:12:19.685827 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:19.686448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:19.693620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.694310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.695292 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.695895 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.700407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:19.701079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:19.723033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.723496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:19.724288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:19.724753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.200608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.203475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.210011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2f9d9262-b082-4b47-9fa1-7eb739cb8278 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.527911 Jun 20 06:12:20.216238 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 101/205] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:19 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.216541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a1161591-3bd9-4bcc-9e72-a5cb1d484c10 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.519278 Jun 20 06:12:20.216541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 105/206] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:19 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.220049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:20.221313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:20.221892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:20.221988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:20.227859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.228323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.228483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.230244 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.230365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.230365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.230543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.230543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.433511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.442756 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:20.444393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cba0b5e5-a59e-4812-92e4-46d26bd95007 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.230936 Jun 20 06:12:20.445921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 106/207] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:20 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.467946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:20.469003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:20.473968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4a1b2c68-e025-41a6-a757-695e5391f173 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.262315 Jun 20 06:12:20.477043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.477878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.478925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.479977 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 102/208] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:20 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:20.480798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.794978 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-7917c717-3fd1-4578-a6d5-f985d9dfc285 req-94a006f4-3ca6-49c7-8625-505af4979de4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "name": "network-vif-plugged", "status": "completed", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:20.807414 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-7917c717-3fd1-4578-a6d5-f985d9dfc285 req-94a006f4-3ca6-49c7-8625-505af4979de4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:20.808385 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-7917c717-3fd1-4578-a6d5-f985d9dfc285 req-94a006f4-3ca6-49c7-8625-505af4979de4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:20.822387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-7917c717-3fd1-4578-a6d5-f985d9dfc285 req-94a006f4-3ca6-49c7-8625-505af4979de4 service nova] Creating event network-vif-plugged:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:12:20.827815 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-7917c717-3fd1-4578-a6d5-f985d9dfc285 req-94a006f4-3ca6-49c7-8625-505af4979de4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038885 Jun 20 06:12:20.828520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 103/209] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:21.119730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.130613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.132125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.133312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1a5fecfb-465d-4afe-a90a-55730a2894e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.686203 Jun 20 06:12:21.133822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 107/210] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:20 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:21.232309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.232966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.234178 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.234950 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.240282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.240817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.241743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.243686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.244777 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.245495 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.246770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.247460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.525245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.528319 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.533834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b8c0ca43-0c35-47f0-968d-a4f17d0409ab tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.307061 Jun 20 06:12:21.534695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 108/211] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:21.539469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.540078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.543227 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ac2ad6c6-5bf4-4e70-b185-83fcd0652ca3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.316956 Jun 20 06:12:21.551863 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 104/212] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:21.552199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.552199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.552199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.552199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.552523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:21.552523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:21.557740 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.558312 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.559170 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:21.559846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:21.771282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.773117 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:21.780819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-77a8d79b-0ef5-4bc4-b9d5-e41f3791e21b tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.244787 Jun 20 06:12:21.781119 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4989ab8c-5d77-42ad-8a4c-5adab27bda2a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.236039 Jun 20 06:12:21.781537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 109/213] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:21.781738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 105/214] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:21 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.150953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.151654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.157653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.158283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.159115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.159606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.553960 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.555268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.562735 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.563474 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.565989 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.566576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.570096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.604824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.610047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.614620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3e5b6435-0a64-4672-834f-0a93a11f788d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.464106 Jun 20 06:12:22.616347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 110/215] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:22.628663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.629548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.638208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.638516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.639361 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.639812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.813364 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.823329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c641bc78-8375-48bd-b537-967a4173de61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.274774 Jun 20 06:12:22.824531 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 106/216] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.830737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.831722 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.841512 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.842215 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.843564 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.844156 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.877550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:22.885264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-870ea3de-6ac1-48f8-93a1-9f3b697d2d0c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.261481 Jun 20 06:12:22.885815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 111/217] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:22.893362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:22.894250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:22.900990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.901491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:22.902281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:22.902732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.058106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:23.068509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-96a0f81e-ca06-4bbe-b9e5-ee04233f6309 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.242605 Jun 20 06:12:23.077987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 107/218] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:23.081225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:23.088653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-caf68940-d3ea-4154-8a61-6b867af62d71 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1315 microversion: 2.1 time: 0.201726 Jun 20 06:12:23.089438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 112/219] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:22 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:23.634718 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:23.635712 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:23.642404 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.643604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.644453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.644987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.788652 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:23.797259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:23.799572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:23.800982 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bb781346-e783-4257-99d3-0e4dc749265c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.170654 Jun 20 06:12:23.811127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 108/220] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:23 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:23.845006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:23.847581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:23.854688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.855227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.856302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.857257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.902737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:23.903509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:23.910757 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.911286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:23.913269 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:23.914167 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.187382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:24.199014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b3fd1e86-7455-45bb-860f-60ee869a653a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.359069 Jun 20 06:12:24.201514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 113/221] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:23 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:24.208240 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:24.211974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:24.212822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:24.215671 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2d0e8530-809d-456a-9578-32b198b50403 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.316738 Jun 20 06:12:24.223463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.223940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.224760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.225288 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 109/222] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:23 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:24.230689 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:24.230866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.231646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:24.239338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.239957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.242941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.243602 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.790813 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:24.791739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:24.812762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a199cf9f-3e55-48f6-9916-9e2ef25f5790 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.608873 Jun 20 06:12:24.813743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 114/223] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:24 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:24.815188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-65201a94-4f1b-44d5-9ac5-e0a9a0f566e0 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1501 microversion: 2.1 time: 0.588272 Jun 20 06:12:24.815923 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 110/224] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:24 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1501 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:24.839520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:24.845025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:24.863173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.865887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:24.868923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:24.869678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.071006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.080188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.083969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.085442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a7d1622-0c7c-4b8b-ab0b-2d8f8cd0eb63 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.270146 Jun 20 06:12:25.086540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 115/225] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:24 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:25.219271 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:25.220312 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:25.228290 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.228781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.229738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.230533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.242597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:25.243585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:25.252027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.252726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.253522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.254081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.474981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.483168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-78b442a4-164f-4380-b0f3-1310539fa8ab tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.248230 Jun 20 06:12:25.484167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 116/226] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:25 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:25.530907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:25.542644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-91d9c060-2b19-400b-a14f-66a43a40958f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.329365 Jun 20 06:12:25.552167 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 111/227] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:25 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:25.830433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:25.831090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:25.838577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.839375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.840378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:25.840929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:25.998805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.008233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b0eceb4f-951c-4540-9560-5f3d52193afd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.182580 Jun 20 06:12:26.009167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 117/228] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:25 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:26.106029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:26.106912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.115350 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.115808 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.116883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.117608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.271569 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.273925 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.282743 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.284852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.286384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0bafaff9-9d12-4c85-be18-d3e854e6ecdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.184356 Jun 20 06:12:26.287395 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 112/229] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:26 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:26.483190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a545c137-7b5f-4109-a456-ddf4ba142cd9"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:26.484440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.491882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.492575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.493469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.493931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.500894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:26.502385 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.515161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.516265 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.517746 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.518449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.668343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:26.711241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.719182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a8286040-7c66-4d09-89aa-93cf621499be tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.222432 Jun 20 06:12:26.728802 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 113/230] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:26 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:26.743348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:26.744345 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:26.752177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.752744 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.753803 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.754306 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.922071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:26.930767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c55e262f-fbbc-4b73-b69a-35bdc4b3c960 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.203731 Jun 20 06:12:26.952999 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 114/231] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:26 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:26.965839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-187368c6-8c7f-4cf8-872f-7057fd2f70e9 req-9540b888-81e5-4774-ae66-9774d2f507c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56a8cd9-74e7-4fa3-8423-12112a7321b7", "name": "network-vif-plugged", "status": "completed", "tag": "335f3da0-2be8-4179-92bc-ba0c3c29d492"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:26.975173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-187368c6-8c7f-4cf8-872f-7057fd2f70e9 req-9540b888-81e5-4774-ae66-9774d2f507c2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:26.975973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-187368c6-8c7f-4cf8-872f-7057fd2f70e9 req-9540b888-81e5-4774-ae66-9774d2f507c2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:26.988454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-187368c6-8c7f-4cf8-872f-7057fd2f70e9 req-9540b888-81e5-4774-ae66-9774d2f507c2 service nova] Creating event network-vif-plugged:335f3da0-2be8-4179-92bc-ba0c3c29d492 for instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 on hv-cinder-80403 Jun 20 06:12:26.993872 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-187368c6-8c7f-4cf8-872f-7057fd2f70e9 req-9540b888-81e5-4774-ae66-9774d2f507c2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033014 Jun 20 06:12:26.994907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 115/232] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:27.026127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.027023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.033351 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.033880 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.034725 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.035322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.466649 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.475700 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2edf02d9-1fb8-42a6-83c6-ccddca917ac8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.453707 Jun 20 06:12:27.497986 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 116/233] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:27.504579 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.505245 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.513008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.513803 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.514946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.515390 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.705708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-745d53a7-8f32-45a0-9262-9ce58a647164 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "POST /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.225647 Jun 20 06:12:27.706956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 118/234] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:12:26 2022] POST /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517/os-volume_attachments => generated 194 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:27.739113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.740796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.765376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.766031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.767790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.769250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.822398 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.840044 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.841659 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.842857 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-dfe92a46-26e3-4ffe-8a17-85983432c522 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.343547 Jun 20 06:12:27.843485 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 117/235] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:27.937449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:27.946496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f075f3ae-c7a3-4ca0-84e2-7ee37c4cc639 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.213427 Jun 20 06:12:27.947100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 119/236] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:27.948444 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:27.949110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:27.956392 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.957324 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:27.957652 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:27.958096 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.105137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:28.113852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5b9817b8-ac42-4a58-9107-0a70efcc3d33 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.169310 Jun 20 06:12:28.114423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 118/237] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:27 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:28.496553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:28.497230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:28.504133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.504647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.505471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.505941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.832508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:28.843315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa0ee8e1-3277-4184-86e4-498c2dd4aa33 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.352970 Jun 20 06:12:28.843911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 120/238] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:28 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:28.864435 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:28.865259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:28.914084 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.914436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.931400 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:28.936494 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:28.979267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:28.980187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:29.001064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.002404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.007503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.008189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.315226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.316016 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.325188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.326643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-20be79ce-feab-4c13-8d46-48e7c843520a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.366548 Jun 20 06:12:29.326781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.327843 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-46b7ce02-e277-4d90-b44b-b521e788048d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1405 microversion: 2.20 time: 0.471080 Jun 20 06:12:29.328187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 121/239] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:28 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:29.338199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:29.338318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 119/240] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:28 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1405 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:29.338408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:29.346236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.346700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.347482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.348232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.509254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:29.517435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5430053e-c645-4b05-b81e-5eb80c6935cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.187557 Jun 20 06:12:29.517999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 122/241] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:29 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:29.869184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:29.870037 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:29.876421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.876916 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:29.877898 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:29.878321 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.007200 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.014745 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bd2ba900-43fd-4636-aead-ff347d64531f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.151113 Jun 20 06:12:30.015310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 120/242] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:29 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:30.345936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.346638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.347208 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.348045 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.357118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.357652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.358518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.359343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.364835 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.365872 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.366866 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.367335 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.694689 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.697465 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.703013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d3f8ceab-fb18-45bf-abd4-8b2bb8f30863 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.361679 Jun 20 06:12:30.704374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 123/243] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:30.707597 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.709266 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.709613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.710283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.710585 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-04eb2457-1de0-439f-8ee6-b0f50b55fc56 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1598 microversion: 2.20 time: 0.368591 Jun 20 06:12:30.711191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 121/244] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1598 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:12:30.717080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.717611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.718436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.718957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.728823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:30.729324 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:30.736198 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.736943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.737792 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:30.738243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:30.907856 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-11dfccc6-6020-4aa1-9256-657eefd87777 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.181837 Jun 20 06:12:30.908555 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 122/245] 10.222.0.39 () {60 vars in 1315 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:12:30.956950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:30.966318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-769cf256-7dcc-497d-b1f7-39214022a129 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1322 microversion: 2.1 time: 0.260347 Jun 20 06:12:30.967563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 124/246] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:30 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:31.031338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:31.033354 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:31.041088 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.041847 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.042877 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.043648 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.114197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f8f53622-b40a-471f-827b-ade950c39df1 req-2187b97d-a3ff-476e-8e07-7229c67df349 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db62494c-25f7-4eab-8c22-5c48182d5a5a", "name": "network-vif-plugged", "status": "completed", "tag": "bfaf0961-1cb5-4edf-b383-b51c377b031f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:31.129807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f8f53622-b40a-471f-827b-ade950c39df1 req-2187b97d-a3ff-476e-8e07-7229c67df349 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.130503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f8f53622-b40a-471f-827b-ade950c39df1 req-2187b97d-a3ff-476e-8e07-7229c67df349 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.146394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f8f53622-b40a-471f-827b-ade950c39df1 req-2187b97d-a3ff-476e-8e07-7229c67df349 service nova] Creating event network-vif-plugged:bfaf0961-1cb5-4edf-b383-b51c377b031f for instance db62494c-25f7-4eab-8c22-5c48182d5a5a on hv-cinder-80403 Jun 20 06:12:31.153033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f8f53622-b40a-471f-827b-ade950c39df1 req-2187b97d-a3ff-476e-8e07-7229c67df349 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045938 Jun 20 06:12:31.153922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 125/247] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:31.255791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:31.268978 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-576da4ca-2c78-4568-9153-e7210fd8bc57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.240135 Jun 20 06:12:31.268978 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 123/248] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:31 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:31.723202 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:31.728284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:31.740225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.740761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.741503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.741947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.893584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:31.902074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1ae0d52a-d02b-427c-a95a-a2d7daf0b5a3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.185147 Jun 20 06:12:31.902993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 126/249] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:31 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:31.983934 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:31.984460 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:31.994266 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:31.997153 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.998146 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:31.999329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:31.999911 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.206468 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.220837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d1a8c7fe-e135-4ce8-9f56-41e16e00af05 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1516 microversion: 2.1 time: 0.239711 Jun 20 06:12:32.221873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 124/250] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:31 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:32.239400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:32.240673 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.248970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.249434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.250585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.252373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.288159 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.288305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'flavor' on Instance uuid a56a8cd9-74e7-4fa3-8423-12112a7321b7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:12:32.289250 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.314871 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.315384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.316222 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.316637 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.522081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9669d246-ab33-4d44-a4cf-32a4e7999b78 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7/action" status: 200 len: 32 microversion: 2.1 time: 0.287413 Jun 20 06:12:32.530559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 127/251] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:12:32 2022] POST /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7/action => generated 32 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:12:32.536643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.537394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.547321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.547700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.549237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.549690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.782976 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.791272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1a4a7302-3df9-4fc0-bf79-e4a99bb64d57 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.509871 Jun 20 06:12:32.792168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 125/252] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:32.798639 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-32cbe075-50fe-4d73-aeb5-bb2e5063c4ea req-4fa94d2b-e8ec-4f27-a8e1-0dda52c4724b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:32.800770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:32.818201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-13341603-6350-492b-ae88-dc127cf15de8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.286090 Jun 20 06:12:32.828222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 128/253] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:32.829911 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-32cbe075-50fe-4d73-aeb5-bb2e5063c4ea req-4fa94d2b-e8ec-4f27-a8e1-0dda52c4724b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.830433 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-32cbe075-50fe-4d73-aeb5-bb2e5063c4ea req-4fa94d2b-e8ec-4f27-a8e1-0dda52c4724b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.841925 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-32cbe075-50fe-4d73-aeb5-bb2e5063c4ea req-4fa94d2b-e8ec-4f27-a8e1-0dda52c4724b service nova] Creating event network-changed:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:12:32.847541 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-32cbe075-50fe-4d73-aeb5-bb2e5063c4ea req-4fa94d2b-e8ec-4f27-a8e1-0dda52c4724b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054029 Jun 20 06:12:32.848407 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 126/254] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:32.919572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:32.920224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:32.927456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.927928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:32.928743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:32.929385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.066723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:33.074395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b7d703a2-e793-47af-8acb-a106d89ea008 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.158836 Jun 20 06:12:33.075197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 129/255] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:32 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:33.820017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:33.821006 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:33.827454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.827925 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.828799 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.830161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.837928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:33.838637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:33.846282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.846821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:33.848434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:33.848972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.044352 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.052506 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-760502b4-b4bc-44c9-8e30-037c180c7315 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.236913 Jun 20 06:12:34.053102 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 127/256] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:33 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:34.058367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.066650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70f0c2fd-54a9-4940-a07d-8ac37435c4c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.235178 Jun 20 06:12:34.067233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 130/257] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:33 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:34.091954 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:34.092515 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:34.099459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.099914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.100672 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:34.101137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:34.229635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:34.237283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ac682df0-9f87-44f2-ac74-22e52a29bef2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.149491 Jun 20 06:12:34.237840 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 128/258] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:34 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:35.071491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.072799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.081048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.082359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.083566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.084077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.086513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.087448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.093698 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.094165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.095011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.095459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.401342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.408659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1282ed11-2f5e-49e9-ae8e-abbc22f97a8e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.342426 Jun 20 06:12:35.409342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 131/259] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:35.417056 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.423454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:35.424127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:35.426197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1366c7cf-db8b-4941-b476-bd9143dd28cf tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.345750 Jun 20 06:12:35.426330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:35.431917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.432086 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 129/260] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:35.432683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.433666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:35.434108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:35.670117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:35.672368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:35.680686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf2be6f3-167b-4310-8846-a94db0ab1be4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.270214 Jun 20 06:12:35.681324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 132/261] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:35 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:36.426217 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.426851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.432961 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.433533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.434308 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.434748 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.448921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.451649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.480492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.480991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.481786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.482234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.655748 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:36.664574 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2760e5d5-f9b2-4937-9977-f015436eb482 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.242170 Jun 20 06:12:36.665179 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 130/262] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:36.679565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:36.687052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8954f39-91b2-45a5-b62b-7926058a3077 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.245964 Jun 20 06:12:36.687609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 133/263] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:36.698174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:36.698789 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:36.705398 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.705854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.706616 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:36.707059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:36.711106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:36.840243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:36.848017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-34b3f4d5-08d8-4a64-881f-de978fa9befc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1362 microversion: 2.1 time: 0.153620 Jun 20 06:12:36.848578 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 131/264] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:36 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:37.370890 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f8596317-0135-47f4-a68a-a44aef3cc1ea req-320e334a-3fca-4657-83a7-4029eeb77d10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0338365-19aa-44e3-bf8b-fa704eb7ce10", "name": "network-vif-plugged", "status": "completed", "tag": "65c2764e-d3ea-45db-917a-f5e152011a84"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:37.382038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f8596317-0135-47f4-a68a-a44aef3cc1ea req-320e334a-3fca-4657-83a7-4029eeb77d10 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.382881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f8596317-0135-47f4-a68a-a44aef3cc1ea req-320e334a-3fca-4657-83a7-4029eeb77d10 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.397618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f8596317-0135-47f4-a68a-a44aef3cc1ea req-320e334a-3fca-4657-83a7-4029eeb77d10 service nova] Creating event network-vif-plugged:65c2764e-d3ea-45db-917a-f5e152011a84 for instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 on hv-cinder-80403 Jun 20 06:12:37.403100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f8596317-0135-47f4-a68a-a44aef3cc1ea req-320e334a-3fca-4657-83a7-4029eeb77d10 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036551 Jun 20 06:12:37.403947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 134/265] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:12:37.681529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:37.682143 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:37.695944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.695944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.695944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.696468 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.709205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:37.710054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:37.716871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.717506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.718460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.719095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.930621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:37.933142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:37.938659 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-37618e22-0362-46f6-9728-475a0c5c895a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.260703 Jun 20 06:12:37.939559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 132/266] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:37 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:37.942459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-023c802e-486a-4b92-bf38-f0a6355df958 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.241446 Jun 20 06:12:37.943212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 135/267] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:37 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:37.956354 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:37.957010 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:37.963027 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.963451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:37.964214 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:37.964651 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.110975 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:38.118815 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-039678f5-aa69-48c3-979d-dd3ab8aef505 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1548 microversion: 2.1 time: 0.176666 Jun 20 06:12:38.119393 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 133/268] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:37 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1548 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:38.138672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:38.139581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:38.147295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.147792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.148651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.149282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.261146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-089f6f1a-aa0b-4c62-9729-f2f118f25c13 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126307 Jun 20 06:12:38.261844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 136/269] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:12:38 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:38.960217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:38.963580 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:38.964375 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:38.966383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:38.978048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.978476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.979254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.981152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.981832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.984932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:38.987410 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:38.988080 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.216035 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:39.224151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-554ec5ce-61fa-4c6d-89a3-136a08a8bb85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.272540 Jun 20 06:12:39.224798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 134/270] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:38 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:39.275023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:39.283700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-baeeb52c-c77e-4e47-aad6-048b91e6cb14 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.327757 Jun 20 06:12:39.284720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 137/271] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:38 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:39.483103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-6fee721e-e460-49fd-abfa-5786993ee403 req-cbc25a6d-bd7f-41c2-b920-d66f01dccdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db62494c-25f7-4eab-8c22-5c48182d5a5a", "tag": "bfaf0961-1cb5-4edf-b383-b51c377b031f"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:39.491540 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-6fee721e-e460-49fd-abfa-5786993ee403 req-cbc25a6d-bd7f-41c2-b920-d66f01dccdc2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:39.492077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-6fee721e-e460-49fd-abfa-5786993ee403 req-cbc25a6d-bd7f-41c2-b920-d66f01dccdc2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:39.504021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-6fee721e-e460-49fd-abfa-5786993ee403 req-cbc25a6d-bd7f-41c2-b920-d66f01dccdc2 service nova] Creating event network-changed:bfaf0961-1cb5-4edf-b383-b51c377b031f for instance db62494c-25f7-4eab-8c22-5c48182d5a5a on hv-cinder-80403 Jun 20 06:12:39.510152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-6fee721e-e460-49fd-abfa-5786993ee403 req-cbc25a6d-bd7f-41c2-b920-d66f01dccdc2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030517 Jun 20 06:12:39.511416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 135/272] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:40.242096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:40.243172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:40.251807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.252567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.253430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.253870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.303736 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:40.304447 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:40.311516 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.312115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.312939 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:40.314089 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:40.463754 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:40.472367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c6a2fd85-af06-49b8-8317-25b4a7a8f563 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.234249 Jun 20 06:12:40.473252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 138/273] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:40 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:40.500372 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:40.508855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-698c7511-a059-4edc-a2e0-69349f95976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.209312 Jun 20 06:12:40.509434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 136/274] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:40 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:41.490835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:41.491446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:41.498301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.498756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.499537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.499979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.526118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:41.526759 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:41.533359 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.533817 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.534589 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:41.535034 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:41.685596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:41.694546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-129996ef-e822-44b6-ab90-4a5552ab6351 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.207787 Jun 20 06:12:41.695131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 139/275] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:41 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:41.711875 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:41.719215 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4d2baa10-bbe3-4b2b-b0ff-893194617fdb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.196983 Jun 20 06:12:41.720048 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 137/276] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:41 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:42.711974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:42.712588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:42.719190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.719651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.720420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.720902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.735116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:42.735737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:42.741899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.742362 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.743135 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:42.743582 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:42.921261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:42.929283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:42.930128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-34bc14f1-6e06-47f7-91fe-61a014d33efe tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.222562 Jun 20 06:12:42.930780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 140/277] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:42 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:42.938720 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1aee86e3-21df-4213-b978-76660cf9fa39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.206557 Jun 20 06:12:42.939697 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 138/278] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:42 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:43.947818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:43.948429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:43.955860 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:43.956398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.956504 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:43.956748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.957535 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.957979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.963791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.964255 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:43.965087 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:43.965534 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:44.186874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:44.190862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:44.195122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e720e8d5-6b17-47b9-b8ab-0dce1865eb87 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.251154 Jun 20 06:12:44.195707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 141/279] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:43 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:44.198178 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7c8c00c7-eb69-4d2f-af3c-0f8ee6ea4ada tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.246840 Jun 20 06:12:44.198758 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 139/280] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:43 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:45.213467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:45.214081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:45.216354 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:45.217008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:45.221964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.222418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.223187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.223622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.223913 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.224370 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.225168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:45.225617 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:45.446172 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:45.454284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:45.455155 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0ef7761a-d702-4b29-9ca4-9560894f2032 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.242463 Jun 20 06:12:45.455913 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 140/281] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:45 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:45.462936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5addbab3-558f-456e-a134-fcc1cb59ec73 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.253499 Jun 20 06:12:45.463504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 142/282] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:45 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:46.472523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:46.473188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:46.479256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.479713 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.480483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.480958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.481078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:46.481569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:46.489122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.489603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.490373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:46.490815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:46.640120 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:46.647661 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-945f236a-8a9c-4af2-a2f5-c65c26f4d916 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.179491 Jun 20 06:12:46.648237 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 141/283] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:46 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:46.756339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:46.763698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-182a87ae-0a0e-4703-be29-6a8e7a3d6211 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.286813 Jun 20 06:12:46.764259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 143/284] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:46 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:47.664851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:47.665464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:47.672535 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.673051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.673808 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.674246 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.780892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:47.781547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:47.787837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.788291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.789263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:47.789703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:47.808840 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:47.817283 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-fe6e9128-d9e8-46db-a67b-46ff1eca91a5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.156277 Jun 20 06:12:47.817863 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 142/285] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:47 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:47.919244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:47.927557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b688b7ad-a7a9-45d2-a258-eb91ac9032b1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.150521 Jun 20 06:12:47.928164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 144/286] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:47 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:48.834685 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:48.835365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:48.841650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.842109 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.842879 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.843320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.944678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:48.945659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:48.951872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.952520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.953117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:48.953556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:48.978042 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:48.987945 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7bdde76a-953e-4edf-bf22-fb87ecc5ec44 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.157156 Jun 20 06:12:48.989323 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 143/287] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:48 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:49.083670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:49.091042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d860ef3f-a515-4fcb-8f06-55a975f17acf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.150499 Jun 20 06:12:49.091601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 145/288] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:48 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:50.005888 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:50.006515 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:50.013113 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.013800 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.014862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.015316 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.107160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:50.108431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:50.115285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.115736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.116512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:50.117078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:50.151024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:50.158880 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2c5cdba1-8f0d-4247-a9bc-2798d7cc81d5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.156747 Jun 20 06:12:50.159593 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 144/289] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:50 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:50.254172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:50.261759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-da506b3f-7758-428f-b04f-244f4ec9f522 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.158414 Jun 20 06:12:50.262328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 146/290] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:50 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:51.175979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:51.176523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:51.182496 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.182948 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.183715 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.184149 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.279896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:51.280517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:51.288237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.288725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.289516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:51.289975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:51.312806 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:51.321103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b5259477-0442-42d7-92fb-69e9396e9202 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.149562 Jun 20 06:12:51.321679 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 145/291] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:51 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:51.429535 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:51.437310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d7ac2102-f1b1-46a6-91ca-73f27c663156 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1364 microversion: 2.1 time: 0.161518 Jun 20 06:12:51.438733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 147/292] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:51 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:52.339068 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:52.339726 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:52.346848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.347348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.348147 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.348584 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.461243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:52.461933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:52.469281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.470281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.471355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.471897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.486420 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:52.494642 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b4961be6-31cc-43db-aefa-2d1c08e70827 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.160576 Jun 20 06:12:52.495432 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 146/293] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:52 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:52.611036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:52.618744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f5997be2-a156-4e04-88ec-11cd0cd12d8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1554 microversion: 2.1 time: 0.164535 Jun 20 06:12:52.619315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 148/294] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:52 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1554 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:52.636223 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:52.636747 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:52.643338 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.643797 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.644569 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:52.645052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:52.728398 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-69d1a329-9fad-4617-894b-539ff3d0e610 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096076 Jun 20 06:12:52.729032 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 147/295] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:12:52 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:53.511266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:53.511885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:53.519719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.520244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.521051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:53.521502 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:53.870962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:53.879230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cc0d2527-d91b-4768-80e2-0f015d2b7e61 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.371847 Jun 20 06:12:53.879794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 149/296] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:53 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:54.238081 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-c64d59c0-e136-4be6-9426-be4b35c0ff16 req-2d220ebe-eabd-48a8-97d5-87a3b0ae5464 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0338365-19aa-44e3-bf8b-fa704eb7ce10", "tag": "65c2764e-d3ea-45db-917a-f5e152011a84"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:12:54.246297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-c64d59c0-e136-4be6-9426-be4b35c0ff16 req-2d220ebe-eabd-48a8-97d5-87a3b0ae5464 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.246808 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-c64d59c0-e136-4be6-9426-be4b35c0ff16 req-2d220ebe-eabd-48a8-97d5-87a3b0ae5464 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.258989 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-c64d59c0-e136-4be6-9426-be4b35c0ff16 req-2d220ebe-eabd-48a8-97d5-87a3b0ae5464 service nova] Creating event network-changed:65c2764e-d3ea-45db-917a-f5e152011a84 for instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 on hv-cinder-80403 Jun 20 06:12:54.264302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-c64d59c0-e136-4be6-9426-be4b35c0ff16 req-2d220ebe-eabd-48a8-97d5-87a3b0ae5464 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031137 Jun 20 06:12:54.265061 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 148/297] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:12:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:12:54.899506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:54.900626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:54.909847 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.910449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.911511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:54.912226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:54.928686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:55.062191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:55.070406 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8983c0ab-c2a8-4ec0-b1b7-86c057d66053 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.178499 Jun 20 06:12:55.071062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 150/298] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:54 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:55.789148 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:55.789741 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:55.796290 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.797050 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.798595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.799513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.818243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:12:55.829256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Going to try to terminate instance {{(pid=117586) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:12:55.931262 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-3ca2a0dd-cf48-49ca-9f76-84cce999e824 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 204 len: 0 microversion: 2.1 time: 0.147074 Jun 20 06:12:55.931827 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 149/299] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:12:55 2022] DELETE /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:12:55.941087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:55.941712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:55.948325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.948844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:55.949653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:55.950100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:56.088960 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:56.089949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:56.097729 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:56.098455 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:56.099413 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:56.100018 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:56.122495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:56.134372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a475f107-b315-442a-bc4f-031d3cc0fce6 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1553 microversion: 2.1 time: 0.198247 Jun 20 06:12:56.134972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 151/300] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:55 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1553 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:56.260416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:56.268437 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6ba89368-51aa-460b-ab7c-a6ffbfb57e54 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.184432 Jun 20 06:12:56.269144 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 150/301] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:56 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:57.151716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:57.152323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:57.158752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.159208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.159973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.160413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.288157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:57.289014 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:57.294936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:57.295280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.295851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.296874 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:57.298223 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:57.303773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-313182f1-5ad2-4cc7-999a-d8266866455c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1553 microversion: 2.1 time: 0.155805 Jun 20 06:12:57.315149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 152/302] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:57 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1553 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:57.435522 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:57.445846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1591f536-23d2-481b-89c8-48baa23a0966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.163675 Jun 20 06:12:57.446595 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 151/303] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:57 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:58.322351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:58.322958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:58.329446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.329905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.330675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.331114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.463061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:58.463485 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:58.464883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:58.471442 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.472030 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.472684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c4ee5306-d925-4e06-8045-c1869b29c726 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1553 microversion: 2.1 time: 0.154116 Jun 20 06:12:58.473017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:58.473455 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:58.482323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 153/304] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:58 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1553 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:12:58.612663 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:58.622013 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0a526b8c-088f-40be-b4c4-875335500640 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.163112 Jun 20 06:12:58.623316 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 152/305] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:58 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:59.490512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:59.491152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:59.497575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.498044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.499022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.499466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.641933 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:12:59.643394 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:12:59.650614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.651247 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.652150 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:12:59.652592 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:12:59.661975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:59.671154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a034f16-4535-415e-833e-4297acd11e0c tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1553 microversion: 2.1 time: 0.184433 Jun 20 06:12:59.672434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 154/306] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:59 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1553 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:12:59.802063 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:12:59.819281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-07cdd480-eca8-4c0c-b84b-41b584df976e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.183696 Jun 20 06:12:59.819868 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 153/307] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:12:59 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:00.152003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-e13b629e-4078-4ce7-94e1-fcd90f6f17e6 req-9bb0e2a3-e95f-48d2-b4d8-a2adde69d535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d50c90f0-0a14-4140-a77a-4a13f3011517", "name": "network-vif-deleted", "tag": "d09a8a67-811d-4da5-90e8-a7424f4f3d1a"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:00.161426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e13b629e-4078-4ce7-94e1-fcd90f6f17e6 req-9bb0e2a3-e95f-48d2-b4d8-a2adde69d535 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:00.161960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e13b629e-4078-4ce7-94e1-fcd90f6f17e6 req-9bb0e2a3-e95f-48d2-b4d8-a2adde69d535 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.176649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-e13b629e-4078-4ce7-94e1-fcd90f6f17e6 req-9bb0e2a3-e95f-48d2-b4d8-a2adde69d535 service nova] Creating event network-vif-deleted:d09a8a67-811d-4da5-90e8-a7424f4f3d1a for instance d50c90f0-0a14-4140-a77a-4a13f3011517 on hv-cinder-80403 Jun 20 06:13:00.182268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-e13b629e-4078-4ce7-94e1-fcd90f6f17e6 req-9bb0e2a3-e95f-48d2-b4d8-a2adde69d535 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 Jun 20 06:13:00.182869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 155/308] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:00.688570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:00.689109 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:00.695288 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:00.695751 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.696524 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:00.697067 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.766325 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:00.774310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d4ff7276-aad9-4883-80bd-8decda3ccb02 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1346 microversion: 2.1 time: 0.089708 Jun 20 06:13:00.774874 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 154/309] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:00 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1346 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:00.836316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:00.837052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:00.844454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:00.845387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.846408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:00.846860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:00.986377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:00.993842 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b1ca4a31-4c2b-4995-9e00-9b78b9c7c22a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.162316 Jun 20 06:13:00.994398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 156/310] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:00 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:01.791388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:01.792006 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:01.798712 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.799162 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.799931 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.800459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.832490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:01.832985 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:01.833452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.objects.instance [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lazy-loading 'fault' on Instance uuid d50c90f0-0a14-4140-a77a-4a13f3011517 {{(pid=117586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:13:01.877189 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f811cc65238425a85c2f8c5828984d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c5be30cc344f1cacb822eb5b55d461', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:01.885277 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5ab1b8b2-eafe-4c52-ba04-7daf11e592a3 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 200 len: 1351 microversion: 2.1 time: 0.097692 Jun 20 06:13:01.885839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 155/311] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:01 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:02.009515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:02.010326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:02.017241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.017777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.018657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.019174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.154698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:02.162494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-db545cab-27eb-440a-810e-9123417f27c3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.156831 Jun 20 06:13:02.163061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 157/312] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:02 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:02.902068 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:02.902677 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:02.904653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:02.910355 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.910790 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.911556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:02.911992 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:02.926110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] HTTP exception thrown: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Request method failure captured: Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 HTTP/1.1 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA-D22QFmrHGNY_nvCRHMloUw8MkOMmn4BZCt-CZl_w8nV3yoJrrwQksrMrtmteEjDpAIO6xjFZkZKIJkAvg-Nc-EjXdUgTWhL7G93q5ZN0bnRlvIh2Lm8hlsWrCqyMfdVXTSR3cD9qoYdO96HcAwsxIQec5yJsAnOWLjZqYrGVqgEc Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:02.931008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}] Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 8f811cc65238425a85c2f8c5828984d7 Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: > Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:02.932608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': 'd50c90f0-0a14-4140-a77a-4a13f3011517'} Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:02.933716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:02.934901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:02.936302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Returning 404 to user: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:02.936302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-51fcb67a-3343-440c-a78b-c98bb3ad64a2 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 404 len: 111 microversion: 2.1 time: 0.034214 Jun 20 06:13:02.936302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 156/313] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:02 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:03.041966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:03.042908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:03.049330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.049865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.050571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.051016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.077585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] HTTP exception thrown: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Request method failure captured: Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517/os-volume_attachments HTTP/1.1 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-D22QFmrHGNY_nvCRHMloUw8MkOMmn4BZCt-CZl_w8nV3yoJrrwQksrMrtmteEjDpAIO6xjFZkZKIJkAvg-Nc-EjXdUgTWhL7G93q5ZN0bnRlvIh2Lm8hlsWrCqyMfdVXTSR3cD9qoYdO96HcAwsxIQec5yJsAnOWLjZqYrGVqgEc Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:13:03.090963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}] Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 8f811cc65238425a85c2f8c5828984d7 Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:03.092325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'server_id': 'd50c90f0-0a14-4140-a77a-4a13f3011517'} Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:03.093129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:03.094296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:03.095528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Returning 404 to user: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:03.095528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0ffda130-5ca9-49be-9d8a-223fa90b05f4 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.055187 Jun 20 06:13:03.095528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 158/314] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:13:03 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:03.179873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:03.180486 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:03.186895 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.187464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.189357 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:03.189791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:03.325820 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:03.333932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-57b37fc1-b2ad-4fb4-b858-ce3d6d9e4aef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.157988 Jun 20 06:13:03.334490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 157/315] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:03 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:04.306745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:04.307303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:04.314070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.314529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.315810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.315947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.330265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] HTTP exception thrown: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Request method failure captured: Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 HTTP/1.1 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-D22QFmrHGNY_nvCRHMloUw8MkOMmn4BZCt-CZl_w8nV3yoJrrwQksrMrtmteEjDpAIO6xjFZkZKIJkAvg-Nc-EjXdUgTWhL7G93q5ZN0bnRlvIh2Lm8hlsWrCqyMfdVXTSR3cD9qoYdO96HcAwsxIQec5yJsAnOWLjZqYrGVqgEc Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:13:04.332414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}] Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 8f811cc65238425a85c2f8c5828984d7 Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.333899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'd50c90f0-0a14-4140-a77a-4a13f3011517'} Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:04.334708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.336039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.337805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Returning 404 to user: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:04.337805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-94f05c8f-d8d7-45c3-912e-01084540be56 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 404 len: 111 microversion: 2.1 time: 0.031209 Jun 20 06:13:04.337805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 159/316] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:13:04 2022] DELETE /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:04.342528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:04.343140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] [instance: d50c90f0-0a14-4140-a77a-4a13f3011517] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:04.350031 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.350180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:04.350490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.350830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:04.351376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.351822 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.357237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.357688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.358452 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:04.358925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:04.366141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] HTTP exception thrown: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Request method failure captured: Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 HTTP/1.1 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA-D22QFmrHGNY_nvCRHMloUw8MkOMmn4BZCt-CZl_w8nV3yoJrrwQksrMrtmteEjDpAIO6xjFZkZKIJkAvg-Nc-EjXdUgTWhL7G93q5ZN0bnRlvIh2Lm8hlsWrCqyMfdVXTSR3cD9qoYdO96HcAwsxIQec5yJsAnOWLjZqYrGVqgEc Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:04.367742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/a1c5be30cc344f1cacb822eb5b55d461"}]}] Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: a1c5be30cc344f1cacb822eb5b55d461 Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-DeleteServersTestJSON-509493720 Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 8f811cc65238425a85c2f8c5828984d7 Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-DeleteServersTestJSON-509493720-project Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: > Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.368955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': 'd50c90f0-0a14-4140-a77a-4a13f3011517'} Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:04.369626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. Jun 20 06:13:04.370688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:04.371648 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] Returning 404 to user: Instance d50c90f0-0a14-4140-a77a-4a13f3011517 could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:04.371648 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-196a81e8-5041-41a2-92f7-e5522173a886 tempest-DeleteServersTestJSON-509493720 tempest-DeleteServersTestJSON-509493720-project] 10.222.0.39 "GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517" status: 404 len: 111 microversion: 2.1 time: 0.030565 Jun 20 06:13:04.373348 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 158/317] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:04 2022] GET /compute/v2.1/servers/d50c90f0-0a14-4140-a77a-4a13f3011517 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:04.529696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:04.538485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6c4fceae-29d6-4578-9202-031584fa48c1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.192156 Jun 20 06:13:04.539921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 160/318] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:04 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:05.555320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:05.555931 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:05.561913 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.563051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.563810 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:05.564247 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:05.992942 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:06.002211 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7ab67ee0-3623-4ff9-b0eb-16d17a9f9eb1 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.450709 Jun 20 06:13:06.003260 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 159/319] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:05 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:07.019241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:07.022770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:07.036853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=58 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:07.039509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.044638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.046225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:07.047551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:07.362023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:07.372574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3524182e-5ae1-4867-875e-2a065b6ed5b9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.357272 Jun 20 06:13:07.374043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 161/320] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:07 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:08.391205 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:08.391816 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:08.400823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.401520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.402548 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:08.403139 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:08.634177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:08.644302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b3557d0b-73ec-48b3-8c5e-95324aee30d8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.258427 Jun 20 06:13:08.644904 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 160/321] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:08 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:09.661291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:09.662500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:09.669509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.669969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.670754 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:09.671197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:09.871678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:09.881583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-454ce8fd-d81c-4540-a68a-921562c84fbb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.224265 Jun 20 06:13:09.882449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 162/322] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:09 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:09.985638 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d946f0f1-fffb-414b-9f06-57d5e2d0390b tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Action: 'create', calling method: .version_select at 0x7f21ee4be790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1965963979", "metadata": {"Type": "work"}}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d946f0f1-fffb-414b-9f06-57d5e2d0390b tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 122 Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:10.009406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1965963979", "metadata": {"Type": "work"}}} Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: Jun 20 06:13:10.010861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1965963979', 'metadata': {'Type': 'work'}}}} Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi '#$%' Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.011903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:13:10.013526 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:13:10.016074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 20 06:13:10.016074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.016074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d946f0f1-fffb-414b-9f06-57d5e2d0390b tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.016074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d946f0f1-fffb-414b-9f06-57d5e2d0390b tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.158204 Jun 20 06:13:10.016074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 161/323] 10.222.0.39 () {60 vars in 1155 bytes} [Mon Jun 20 06:13:09 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 159 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:13:10.021529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3ba74a29-2dec-49e9-9474-c76f222a53d0 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Action: 'create', calling method: .version_select at 0x7f21ed0f1d30>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-450739616", "metadata": {"Type": "work"}}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3ba74a29-2dec-49e9-9474-c76f222a53d0 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 119 Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:13:10.024685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-450739616", "metadata": {"Type": "work"}}} Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:13:10.025873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-450739616', 'metadata': {'Type': 'work'}}}} Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi '0' Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.026582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:13:10.027822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:13:10.029054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 20 06:13:10.029054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.029054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3ba74a29-2dec-49e9-9474-c76f222a53d0 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.029054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3ba74a29-2dec-49e9-9474-c76f222a53d0 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008414 Jun 20 06:13:10.029054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 163/324] 10.222.0.39 () {60 vars in 1155 bytes} [Mon Jun 20 06:13:10 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:13:10.037396 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c456ad3a-bdba-4cb3-a2f0-afd9cf8ca2ee tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Action: 'create', calling method: .version_select at 0x7f21ed932160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1615162815", "metadata": {"Type": "work"}}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c456ad3a-bdba-4cb3-a2f0-afd9cf8ca2ee tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 119 Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:10.039906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1615162815", "metadata": {"Type": "work"}}} Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: Jun 20 06:13:10.041256 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1615162815', 'metadata': {'Type': 'work'}}}} Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise error Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi '' Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.041971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 20 06:13:10.043176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 20 06:13:10.044171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 20 06:13:10.044171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.044171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c456ad3a-bdba-4cb3-a2f0-afd9cf8ca2ee tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.044171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c456ad3a-bdba-4cb3-a2f0-afd9cf8ca2ee tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008428 Jun 20 06:13:10.044171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 162/325] 10.222.0.39 () {60 vars in 1155 bytes} [Mon Jun 20 06:13:10 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:13:10.051974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f5874794-124c-4955-9b6b-2f628c8c67a1 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Calling method '.version_select at 0x7f21ed123e50>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.086053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-f5874794-124c-4955-9b6b-2f628c8c67a1 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] HTTP exception thrown: Volume tempest-invalid-948900110 could not be found. Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f5874794-124c-4955-9b6b-2f628c8c67a1 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-948900110 HTTP/1.1 Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:13:10.088940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Volume tempest-invalid-948900110 could not be found. Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'tempest-invalid-948900110'} Jun 20 06:13:10.090367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-948900110 could not be found. (HTTP 404) (Request-ID: req-7013b054-8cfe-42ac-927f-bed0770da83a) Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.091279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:13:10.092573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-948900110 could not be found. Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:10.095316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-948900110 could not be found. Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-948900110 could not be found. Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f5874794-124c-4955-9b6b-2f628c8c67a1 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 404 to user: Volume tempest-invalid-948900110 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f5874794-124c-4955-9b6b-2f628c8c67a1 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-948900110" status: 404 len: 98 microversion: 2.1 time: 0.042341 Jun 20 06:13:10.099629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 164/326] 10.222.0.39 () {58 vars in 1214 bytes} [Mon Jun 20 06:13:10 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-948900110 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:13:10.105859 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-89515240-55a0-4356-80e9-40ec7dd9043e tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006129 Jun 20 06:13:10.106872 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 163/327] 10.222.0.39 () {58 vars in 1139 bytes} [Mon Jun 20 06:13:10 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:13:10.118679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-96d1035b-dfc2-46e3-9bdf-e70dc0a5f6f4 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003783 Jun 20 06:13:10.120473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 165/328] 10.222.0.39 () {58 vars in 1136 bytes} [Mon Jun 20 06:13:10 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 20 06:13:10.128350 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-797f327e-6698-467a-b027-e40dab586a0d tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Calling method '.version_select at 0x7f21edc0a940>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.158727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-797f327e-6698-467a-b027-e40dab586a0d tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] HTTP exception thrown: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-797f327e-6698-467a-b027-e40dab586a0d tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: DELETE /compute/v2.1/os-volumes/35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 HTTP/1.1 Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:10.160646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': '35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3'} Jun 20 06:13:10.162115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. (HTTP 404) (Request-ID: req-e8c7822c-adc0-4eee-a9a4-668567c4db0e) Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.162852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 20 06:13:10.163831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 20 06:13:10.164848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-797f327e-6698-467a-b027-e40dab586a0d tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 404 to user: Volume 35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-797f327e-6698-467a-b027-e40dab586a0d tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3" status: 404 len: 109 microversion: 2.1 time: 0.037786 Jun 20 06:13:10.165839 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 164/329] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:13:10 2022] DELETE /compute/v2.1/os-volumes/35ab76ba-a1f0-42c2-98d1-1a2e99e59bf3 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:10.171497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bc2434c5-134e-4482-9c23-825464923df8 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Calling method '.version_select at 0x7f21ed0f1c10>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.200102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-bc2434c5-134e-4482-9c23-825464923df8 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] HTTP exception thrown: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bc2434c5-134e-4482-9c23-825464923df8 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Request method failure captured: Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/os-volumes/aa89e499-2577-4e69-9113-daa349ddacd2 HTTP/1.1 Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA_1PFx3q1bQfUniInO3Dp2b12wMFPcIcioxzVCx5ThFHa07R6GVGuW21QixyDYkxEHLVkkOMnAIOxZKvp_ZoqT-N_qMQJ0g5g15Kn7GdbMX3j0g7tm0PrjaKhwkIt3jT9QR8L95dCPAHBb6iAuEjgO6NwzHjOIGDInnGWvWeE2ESGw Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:13:10.202395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/15af7e20eeb149b6a4b853aaa479f2ab"}]}] Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 15af7e20eeb149b6a4b853aaa479f2ab Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesNegativeTest-726377190 Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 69badb3f3a684656b89b9ade1726a08c Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesNegativeTest-726377190-project Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'aa89e499-2577-4e69-9113-daa349ddacd2'} Jun 20 06:13:10.204528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. (HTTP 404) (Request-ID: req-7ab12699-ad69-4bed-adad-085a9fac43a7) Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.205351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:13:10.206374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:13:10.207369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bc2434c5-134e-4482-9c23-825464923df8 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] Returning 404 to user: Volume aa89e499-2577-4e69-9113-daa349ddacd2 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bc2434c5-134e-4482-9c23-825464923df8 tempest-VolumesNegativeTest-726377190 tempest-VolumesNegativeTest-726377190-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/aa89e499-2577-4e69-9113-daa349ddacd2" status: 404 len: 109 microversion: 2.1 time: 0.036921 Jun 20 06:13:10.208488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 166/330] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:13:10 2022] GET /compute/v2.1/os-volumes/aa89e499-2577-4e69-9113-daa349ddacd2 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:13:10.898262 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:10.899264 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:10.907605 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.908453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:10.909616 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:10.910281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:11.087425 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:11.096418 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-af25455c-e85f-4123-91bf-e300945be908 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.201913 Jun 20 06:13:11.097023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 165/331] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:10 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:12.115369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:12.116004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:12.122651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.123285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.124236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:12.124811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:12.258676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:12.275320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2969393f-89bd-4fb6-8655-e8de5c3239ce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.164646 Jun 20 06:13:12.275892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 167/332] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:12 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:13.293158 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:13.293987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:13.300852 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.301452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.302323 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:13.302885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:13.435635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:13.443053 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0398c8fd-d73b-442e-aa7f-cd9dd86d1d88 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.154276 Jun 20 06:13:13.443804 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 166/333] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:13 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:14.460685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:14.461413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:14.468968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.469438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.470220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:14.470676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:14.601125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:14.608641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-745fbe93-eb09-41b3-9259-bd473b17c49b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.152428 Jun 20 06:13:14.609440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 168/334] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:14 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:15.625959 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:15.626487 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:15.632637 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.633140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.633906 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:15.634353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:15.763463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:15.771086 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f972ba7b-2b9b-4698-9109-e7e3e0f0b23e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.149220 Jun 20 06:13:15.771643 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 167/335] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:15 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:16.787757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:16.788328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:16.794814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.795264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.796572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:16.797033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:16.923266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:16.930895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eaed8d46-d61b-413d-be6d-fead83e37e64 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.147024 Jun 20 06:13:16.931421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:16 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:17.948493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:17.949134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:17.955822 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.956276 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:17.957062 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:17.957497 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:18.094953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:18.102401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8867604d-421f-4452-96aa-18490a661e86 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.157715 Jun 20 06:13:18.102961 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 168/337] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:17 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:19.119276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:19.119891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:19.126920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.127379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.128161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:19.128606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:19.260851 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:19.269140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2c1f1264-0811-4c94-800e-2986c6be68fb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.153600 Jun 20 06:13:19.269706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:19 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:20.286502 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:20.287255 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:20.293846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.294296 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.295061 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:20.295499 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:20.310920 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:20.432370 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:20.440533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5a8502ba-e617-4102-8ec8-ebda71f532e4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.157886 Jun 20 06:13:20.441384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 169/339] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:20 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:21.458361 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:21.458948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:21.465488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.465942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.466704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:21.467144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:21.600825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:21.609798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-719cd4b6-78b5-47cc-900c-afdb23905ffb tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.153989 Jun 20 06:13:21.610380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 171/340] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:21 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:22.627259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:22.627877 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:22.634025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.634491 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.635265 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:22.635710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:22.765336 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:22.773021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a516df36-5878-479a-9ca9-a02c79a6e64c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.150105 Jun 20 06:13:22.773583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 170/341] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:22 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:23.789676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:23.790287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:23.798170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.798630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:23.799410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:23.799850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:23.938675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:23.946151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eb0c850e-c92b-496b-b6c0-98ffe6754098 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1522 microversion: 2.1 time: 0.160298 Jun 20 06:13:23.946940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 172/342] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:23 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:24.963326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:24.963939 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:24.970542 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.970996 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:24.971762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:24.972205 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.103490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:25.111785 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-23b7124b-e6dc-4dc3-b85f-08bf66297dd3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1502 microversion: 2.1 time: 0.152203 Jun 20 06:13:25.112396 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 171/343] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:24 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1502 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:25.129296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:25.129839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:25.138762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.139765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.140712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:25.141163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:25.143878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:25.279344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:25.287324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7573a03b-773f-4400-b215-0fad3be51391 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1515 microversion: 2.1 time: 0.161925 Jun 20 06:13:25.287981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 173/344] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:25 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:27.687900 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:27.688960 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:27.695227 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.695657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.696424 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.696905 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.722341 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.objects.instance [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'flavor' on Instance uuid ba092673-d9fc-41fc-8951-70d3ece80024 {{(pid=117586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:13:27.839535 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5a78ac7b-ac19-4ef5-90c4-a7a08ebac805 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/action" status: 200 len: 32 microversion: 2.1 time: 0.155942 Jun 20 06:13:27.840212 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 172/345] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:13:27 2022] POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:13:27.850024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:27.850639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:27.856918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.857384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:27.858157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:27.858601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:28.025459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:28.045279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-31a328ae-2b7f-4099-9045-806beef5abe3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.199083 Jun 20 06:13:28.045860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 174/346] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:27 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:29.064416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:29.065653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:29.081095 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.081750 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.082613 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:29.083140 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:29.296844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:29.306793 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8aea2762-0dd9-465a-832f-e7a4bae6d8e9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.247252 Jun 20 06:13:29.308236 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 173/347] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:29 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:30.325949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:30.326563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:30.335782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:30.336499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.337369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:30.337822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:30.498626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:30.508079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9d1f5fd5-e6ab-4a45-8d7c-a7d7bc9409c8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.185937 Jun 20 06:13:30.508652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 175/348] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:30 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:31.528435 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:31.529076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:31.535520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.535967 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.536964 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:31.537436 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:31.742633 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:31.750953 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8c3d6779-1300-441c-837e-1b923c00ce98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.226253 Jun 20 06:13:31.751527 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 174/349] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:31 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:32.768323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:32.768968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:32.775319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.775773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.776544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:32.777013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:32.912815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:32.920225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-778ad76e-7c52-494e-8b52-53457446b2cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.156883 Jun 20 06:13:32.920822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 176/350] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:32 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:33.937657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:33.938392 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:33.940416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=30 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:33.945998 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.946528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:33.947366 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:33.947878 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:34.222092 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:34.229513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8a96bca3-14ff-4b34-834b-4bd9bad069a8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.296499 Jun 20 06:13:34.230077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 175/351] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:33 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:35.246180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:35.246797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:35.253802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.254264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.255031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:35.255476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:35.395509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:35.403011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b2383e2f-7c75-425b-b0cc-c435181a88fe tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.160616 Jun 20 06:13:35.403577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 177/352] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:35 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:36.420315 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:36.421202 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:36.428235 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.428690 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:36.429488 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:36.429930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:36.571116 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:36.578440 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8f439504-2e89-4361-a6aa-3a7c7085b076 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.161920 Jun 20 06:13:36.579071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 176/353] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:36 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:37.595321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:37.595920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:37.598183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=26 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:37.603510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:37.603986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.604748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:37.605223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:37.731594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:37.739790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dc173999-3039-4337-8832-2378bb253c21 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.148844 Jun 20 06:13:37.740353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 178/354] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:37 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:38.756802 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:38.757519 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:38.763714 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.764170 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.764958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:38.765453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:38.902988 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:38.911063 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bc5c4716-0524-4658-8cd8-07d711139533 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.158179 Jun 20 06:13:38.911629 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 177/355] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:38 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:39.928061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:39.928683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:39.938325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.939020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:39.940216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:39.940937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:40.084628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:40.093954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-250e2f63-1264-4111-bfdf-61d37596313c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.169186 Jun 20 06:13:40.094531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 179/356] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:39 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:41.110464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:41.111688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:41.117765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:41.118224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:41.119155 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:41.119545 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:41.257323 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:41.266481 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-cb3ae6b0-77cd-49cb-8923-b8fc576ce0f4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.160592 Jun 20 06:13:41.267271 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 178/357] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:41 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:42.284331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:42.284958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:42.292914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.293376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.294192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:42.294633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:42.428261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:42.435638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-10560c5e-f015-4018-9b97-c041c8d14f7c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.156216 Jun 20 06:13:42.436196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 180/358] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:42 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:43.452274 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:43.453033 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:43.459415 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.459528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.460239 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.460678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.479599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-254243140", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "networks": [{"uuid": "d370b089-abad-4168-bc79-e0225529316a"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:43.537125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] validate_networks() for [('d370b089-abad-4168-bc79-e0225529316a', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:13:43.667765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:43.675327 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-57db2868-6661-4db7-b11a-bd041eca8ff5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.226700 Jun 20 06:13:43.675900 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 179/359] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:43 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:43.940313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:13:43.940786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:13:43.941267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:13:43.941708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:13:43.942099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:13:43.950940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.951397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.952203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:43.953201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:43.971198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Getting quotas for project b38a00f3ffb54dafae0998b26c2478a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:13:43.975334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Getting quotas for user 308284e2c67341d181eac71cf19f92c6 and project b38a00f3ffb54dafae0998b26c2478a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:13:43.987023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:13:43.989357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:13:44.039149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-42482695-97d0-4272-add8-efaa2612a60c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.563153 Jun 20 06:13:44.040051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 181/360] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:13:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:13:44.050534 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c344859a-59c3-4e39-9927-dcf83f3a2c1f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:44.051320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c344859a-59c3-4e39-9927-dcf83f3a2c1f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:44.105061 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c344859a-59c3-4e39-9927-dcf83f3a2c1f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:44.112476 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c344859a-59c3-4e39-9927-dcf83f3a2c1f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1213 microversion: 2.1 time: 0.065861 Jun 20 06:13:44.113065 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 180/361] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:44 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:44.692724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:44.693335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:44.699973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:44.700432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:44.701231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:44.701682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:44.827093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:44.834839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-510fc463-c9a5-471a-8bca-ad907784269b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.146527 Jun 20 06:13:44.835404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 182/362] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:44 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:45.129811 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:45.130359 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:45.136599 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.137089 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.137971 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.138413 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.198812 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:45.206553 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-27a263b2-5202-4640-8ee2-4bdd953ef7c1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1209 microversion: 2.1 time: 0.080617 Jun 20 06:13:45.207118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 181/363] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:45 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1209 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:45.851419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:45.851959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:45.858450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.859560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.860589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:45.861051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:45.991486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:45.998913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6d98d8d9-8f7a-415b-b24b-1cc4b4aae463 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.151435 Jun 20 06:13:45.999482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 183/364] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:45 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:46.224074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:46.224680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:46.230676 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.231127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.231883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:46.232322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:46.294322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:46.301793 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0cd24fbf-61e2-44b9-8b82-2e6e58302843 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1209 microversion: 2.1 time: 0.081530 Jun 20 06:13:46.302353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 182/365] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:46 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:47.015501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:47.016136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:47.022657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.023118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.023928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.024377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.153100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:47.161206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4a5190a0-8305-4216-a456-e97b073c6065 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.149665 Jun 20 06:13:47.161778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 184/366] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:47 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:47.319306 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:47.319944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:47.326031 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.326508 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.327280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:47.327707 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:47.388025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:47.396068 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ef55e0b9-3975-4200-b1a1-8b8511eb4137 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1265 microversion: 2.1 time: 0.080915 Jun 20 06:13:47.396626 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 183/367] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:47 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1265 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:48.177733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:48.178348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:48.185022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.185478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.186247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.187517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.314683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:48.322062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c752efc3-4db3-4236-9868-ac5fbfc357a9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.148127 Jun 20 06:13:48.322620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 185/368] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:48 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:48.414122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:48.414742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:48.420750 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.421831 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.422608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:48.423052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:48.484175 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:48.491861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1e918dfd-649c-4689-b41a-8ba590555337 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1265 microversion: 2.1 time: 0.082981 Jun 20 06:13:48.492463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 184/369] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:48 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:49.337914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:49.338453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:49.345129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.345595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.346395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.346844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.483130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:49.491648 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-65671cc2-8de3-40d9-8fce-af56849dac39 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.157699 Jun 20 06:13:49.492527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 186/370] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:49 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:49.509160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:49.509802 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:49.516287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.516760 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.517522 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:49.517957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:49.521867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:49.579707 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:49.587072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6387a0eb-8190-40ce-b94e-83d1b61198f2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1265 microversion: 2.1 time: 0.081743 Jun 20 06:13:49.587630 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 185/371] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:49 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1265 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:50.510698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:50.511721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:50.520180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.520668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.521477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.521941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.603368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:50.603987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:50.611049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.611767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.612837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:50.613282 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:50.692512 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:50.697020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:50.700399 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-101c9ad6-ad3c-4591-8d4e-18f5b441db7a tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1271 microversion: 2.1 time: 0.100871 Jun 20 06:13:50.701015 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 186/372] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:50 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1271 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:50.712474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dfb9c024-59d9-4367-a5a7-27169bfae071 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.205750 Jun 20 06:13:50.713114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 187/373] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:50 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:51.717172 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:51.717718 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:51.724199 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.724773 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.725549 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.725992 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.729755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:51.730366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:51.737880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.738835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:51.739604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:51.740042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:52.158042 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:52.165424 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-15cf5674-df70-401d-baca-fad9ac8f4d92 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.452106 Jun 20 06:13:52.165995 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 187/374] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:51 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:52.170658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:52.178163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fc6f9064-455b-4f0f-a7d0-8d99643205c5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.452100 Jun 20 06:13:52.178709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 188/375] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:51 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:53.182257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:53.182805 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:53.189100 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.189557 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.190328 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.190769 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.195126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:53.195740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:53.202078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.202569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.203298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:53.203748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:53.386676 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:53.389566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:53.396134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-3945b8be-22b0-4461-b9f1-ec6f4a945d93 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.217075 Jun 20 06:13:53.396999 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 188/376] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:53 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:53.397585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3f3427e5-2a35-4430-aa96-6ea72cb61061 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.206418 Jun 20 06:13:53.398147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 189/377] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:53 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:54.411900 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:54.412615 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:54.414571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=2 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.414964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:54.415687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:54.417723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.418482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.420372 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.420857 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.422833 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.423301 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.425948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.426404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.427173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:54.427610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:54.443111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:13:54.618529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:54.622941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:54.626438 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-25e617d8-8670-415a-a869-7e09af3a866f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.218343 Jun 20 06:13:54.627007 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 189/378] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:54 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:54.630351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3bce5e90-7a78-44f4-8138-651a2babcf82 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.219841 Jun 20 06:13:54.630913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 190/379] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:54 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:55.561185 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-48faf1e1-438e-4f64-83bd-a300dedf8777 req-2052cdb5-8a60-41d2-b326-a1ea4199ffb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4acf1d44-a2c5-4202-8142-ddc48b0bddab", "tag": "6d4ddb4a-83c4-49f2-aa8f-b1b15c436285"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:55.573519 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-48faf1e1-438e-4f64-83bd-a300dedf8777 req-2052cdb5-8a60-41d2-b326-a1ea4199ffb8 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.574684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-48faf1e1-438e-4f64-83bd-a300dedf8777 req-2052cdb5-8a60-41d2-b326-a1ea4199ffb8 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.588005 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-48faf1e1-438e-4f64-83bd-a300dedf8777 req-2052cdb5-8a60-41d2-b326-a1ea4199ffb8 service nova] Creating event network-changed:6d4ddb4a-83c4-49f2-aa8f-b1b15c436285 for instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab on hv-cinder-80403 Jun 20 06:13:55.593112 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-48faf1e1-438e-4f64-83bd-a300dedf8777 req-2052cdb5-8a60-41d2-b326-a1ea4199ffb8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035500 Jun 20 06:13:55.593978 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 190/380] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:13:55.646256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:55.647232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:55.647499 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:55.648260 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:55.654790 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.655249 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.656207 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.656783 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.656942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.657520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.658804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:55.659263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:55.857193 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:55.863936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:55.866318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-130b7ed5-cd9e-42a9-8110-7abaad0d1bce tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.222878 Jun 20 06:13:55.867051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 191/381] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:55 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:55.876579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7497b3d3-d44f-416a-a88e-2c09507de1af tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.236983 Jun 20 06:13:55.877390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 191/382] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:55 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:56.883165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:56.883810 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:56.890669 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.891276 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.892049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.892490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.894623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:56.895281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:56.901094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.901557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:56.902329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:56.902777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.085369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:57.088791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:57.093141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c452226a-9fe2-485d-bef3-ab62e849c371 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1501 microversion: 2.1 time: 0.213722 Jun 20 06:13:57.093751 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 192/383] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:56 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1501 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:57.096371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d7222dbf-e5ac-4cf9-9925-b732a57df992 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.206545 Jun 20 06:13:57.096965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 192/384] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:56 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:13:57.109023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f7e009d-cdf4-4544-a8db-61647f667704"}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:57.110388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:57.116191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.116645 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.117470 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.117892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.141074 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] HTTP exception thrown: Cannot 'attach_volume' instance ba092673-d9fc-41fc-8951-70d3ece80024 while it is in vm_state rescued Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Request method failure captured: Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/os-volume_attachments HTTP/1.1 Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 74 Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisA-J8yVqXlvOU9pICRZquWgc6kRnsz6Lcq0D6hxi4Vrduz-utYb-xv1OmgyPq5UmHKsPSHOTR3x-KoqzIoSAh3iEjRh10PIWIz6ednYSLb-_geiar9iS2pa1PxXPbHeTvRJq4oGfGcJQayLtEH2kL4L07-iejUc1D8xrf6uPNHakhLA Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:13:57.142739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}] Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: e1516d2903414b7caf082c32dcdac3eb Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {"volumeAttachment": {"volumeId": "4f7e009d-cdf4-4544-a8db-61647f667704"}} Jun 20 06:13:57.144182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: > Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Cannot 'attach_volume' instance ba092673-d9fc-41fc-8951-70d3ece80024 while it is in vm_state rescued Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'server_id': 'ba092673-d9fc-41fc-8951-70d3ece80024', 'body': {'volumeAttachment': {'volumeId': '4f7e009d-cdf4-4544-a8db-61647f667704'}}} Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ba092673-d9fc-41fc-8951-70d3ece80024 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:13:57.144963 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ba092673-d9fc-41fc-8951-70d3ece80024 while it is in vm_state rescued Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:13:57.146129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ba092673-d9fc-41fc-8951-70d3ece80024 while it is in vm_state rescued Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Returning 409 to user: Cannot 'attach_volume' instance ba092673-d9fc-41fc-8951-70d3ece80024 while it is in vm_state rescued {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-632009e4-6fcd-4b48-a2ec-d6de58c8fbf4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039111 Jun 20 06:13:57.147174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 193/385] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:13:57 2022] POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/os-volume_attachments => generated 152 bytes in 40 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 20 06:13:57.153148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:13:57.153693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:57.159825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.160283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.161102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.161558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.226431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-04dea06b-fc36-4edb-a792-150cd5e952c9 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/action" status: 202 len: 0 microversion: 2.1 time: 0.076960 Jun 20 06:13:57.227070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 193/386] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:13:57 2022] POST /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:13:57.236036 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:57.236640 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:57.243015 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.243475 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.244241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:57.244684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:57.373633 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:57.382132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a1207040-3c1d-432c-923c-db3f99d8838a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.150654 Jun 20 06:13:57.382704 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 194/387] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:57 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:58.114418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:58.115120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:58.121289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:58.121685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:58.122442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:58.122878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:58.256578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:58.263953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5ee6c355-7cef-4f12-bf76-f6776b0ec36e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.154430 Jun 20 06:13:58.264513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 194/388] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:58 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:58.399422 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:58.399960 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:58.406328 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:58.406775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:58.407533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:58.407969 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:58.534846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:58.542207 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2f060575-402f-4f75-9cc0-f4fddd2f2db0 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.146792 Jun 20 06:13:58.542784 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 195/389] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:58 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:59.282335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:59.283058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:59.289676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.290182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.291157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.291657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.419138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:59.426493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-354ea7fe-69e4-42d6-a6af-53ea521e939e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.148482 Jun 20 06:13:59.427060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 195/390] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:59 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:13:59.559232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:13:59.559859 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:13:59.566846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.567300 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.568072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:13:59.568518 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:13:59.697398 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:13:59.705378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-69eeb687-cf2a-4e00-9884-1a869b8d3821 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.150156 Jun 20 06:13:59.705941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 196/391] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:13:59 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:00.444091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:00.444709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:00.451356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.451816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.452595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.453067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.580850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:00.588319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cf040de5-6ee7-4574-b4b6-1686fb26c080 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.148321 Jun 20 06:14:00.588910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 196/392] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:00 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:00.722862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:00.723477 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:00.729516 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.729966 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.730731 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:00.731167 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:00.861765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:00.869228 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ac3264ca-0b12-49b0-8958-9af819aaf8db tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.151144 Jun 20 06:14:00.869787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 197/393] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:00 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:01.610416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:01.612225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:01.621134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.622836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.624132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.624874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.842679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:01.850290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-44d156da-a057-42b4-a4fc-3dd2683b0da3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.247547 Jun 20 06:14:01.851532 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 197/394] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:01 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:01.886222 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:01.886762 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:01.894520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.894987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:01.895766 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:01.896212 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.034324 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:02.041769 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d1bd841b-3a7e-4b6e-94b6-dd57258c8402 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.159476 Jun 20 06:14:02.042330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 198/395] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:01 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:02.869122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:02.887923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:02.899879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.900357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:02.901443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:02.901980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:03.054586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:03.057483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:03.058015 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:03.062646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0e4d40da-416b-4392-8e86-4f45461fb7d3 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.198210 Jun 20 06:14:03.063818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 198/396] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:02 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:03.064439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:03.065003 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:03.065773 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:03.066203 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:03.198803 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:03.207549 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-88df85ba-298b-43b3-aa9b-e464441e3514 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.153915 Jun 20 06:14:03.208125 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 199/397] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:03 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:04.080638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:04.081194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:04.087681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.088138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.088936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.089380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.214823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:04.223029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-15c9bfe6-5e5e-4a56-b069-ee718a3e82e1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.146973 Jun 20 06:14:04.223591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 199/398] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:04 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:04.223806 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:04.224417 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:04.227437 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=52 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:04.231029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.231482 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.232243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:04.232681 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:04.364621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:04.372141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6e1b4528-fc7c-452a-83e0-88beb39549da tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.152062 Jun 20 06:14:04.372727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 200/399] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:04 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:05.240309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:05.240957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:05.247474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.247941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.248775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.249229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.313929 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-74dc5fed-f118-4014-897f-d97fa3802a91 req-40957408-4b6b-4d9b-b443-c028cc78582a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acf1d44-a2c5-4202-8142-ddc48b0bddab", "name": "network-vif-plugged", "status": "completed", "tag": "6d4ddb4a-83c4-49f2-aa8f-b1b15c436285"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:05.325941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-74dc5fed-f118-4014-897f-d97fa3802a91 req-40957408-4b6b-4d9b-b443-c028cc78582a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.326930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-74dc5fed-f118-4014-897f-d97fa3802a91 req-40957408-4b6b-4d9b-b443-c028cc78582a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.345631 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-74dc5fed-f118-4014-897f-d97fa3802a91 req-40957408-4b6b-4d9b-b443-c028cc78582a service nova] Creating event network-vif-plugged:6d4ddb4a-83c4-49f2-aa8f-b1b15c436285 for instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab on hv-cinder-80403 Jun 20 06:14:05.351894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-74dc5fed-f118-4014-897f-d97fa3802a91 req-40957408-4b6b-4d9b-b443-c028cc78582a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047957 Jun 20 06:14:05.352816 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 201/400] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:14:05.389382 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:05.390087 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:05.395575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:05.397010 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.397419 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.398203 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:05.398644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:05.403583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-085c288c-051b-466c-95d2-b6c029715487 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.167265 Jun 20 06:14:05.404232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 200/401] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:05 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:05.528394 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:05.536452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-494c2dd5-d7f7-4413-9c6d-cb13565e0328 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.151463 Jun 20 06:14:05.537055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 202/402] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:05 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:06.421276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:06.422388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:06.428868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.429329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.430095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.430539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.552627 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:06.553302 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:06.559232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.559689 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.560452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:06.560924 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:06.565990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:06.573491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d78e8f33-ee2d-417b-953f-ae2079383558 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.156064 Jun 20 06:14:06.580521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 201/403] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:06 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:06.580677 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:06.691477 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:06.698876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-57ce969e-b7b5-4d54-9fb1-14d024951fa6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.150232 Jun 20 06:14:06.699429 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 203/404] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:06 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:07.592581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:07.593425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:07.605730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.606225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.607150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.607614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.715471 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:07.716298 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:07.724261 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.724738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.725520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:07.726118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:07.740437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:07.747727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8ccee062-f6ed-46e7-b183-fdcc9d62ce27 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.159908 Jun 20 06:14:07.748288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 202/405] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:07 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:07.853259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:07.861437 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-69e3f04b-0e54-40c2-bbe2-cbde7cc0ed77 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.149916 Jun 20 06:14:07.862157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 204/406] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:07 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:08.764261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:08.764907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:08.768013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:08.773164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.773616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.774376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.774814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.879568 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:08.880189 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:08.886174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.886635 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.887401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:08.887848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:08.906962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:08.914266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c109befa-b754-4f18-8ca0-240368985172 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.153806 Jun 20 06:14:08.914959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 203/407] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:08 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:09.022337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:09.029949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-474d0613-275f-4b6a-a33c-97c973acd69d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1509 microversion: 2.1 time: 0.155503 Jun 20 06:14:09.030512 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 205/408] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:08 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:09.931320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:09.931930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:09.939093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:09.939547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:09.940307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:09.940767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.048038 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:10.048632 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:10.054622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.055077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.055876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:10.056315 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:10.076921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:10.085027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-67a91297-4447-4e53-85d4-39cc38977027 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.157456 Jun 20 06:14:10.085612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 204/409] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:09 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:10.185578 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:10.193737 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7ff64058-93fd-4306-a373-dd7e1dd26bbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1515 microversion: 2.1 time: 0.150382 Jun 20 06:14:10.194300 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 206/410] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:10 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:11.101844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:11.102440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:11.108902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.109354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.111252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:11.111690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:11.239363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:11.246827 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4ea36408-b7b0-4754-bf30-30b9c9f64c19 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.148771 Jun 20 06:14:11.247386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 205/411] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:11 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:12.263142 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:12.263765 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:12.270184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.270642 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.271409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:12.271854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:12.404180 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:12.411612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a0b24e66-ae58-4d2d-95ba-680733e8c640 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.152336 Jun 20 06:14:12.412192 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 207/412] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:12 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:13.429272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:13.429909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:13.436367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.436865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.437627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:13.438719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:13.441242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:13.571433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:13.585758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a893481c-6b04-49f6-a07a-899bfb0496b5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.160440 Jun 20 06:14:13.586343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 206/413] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:13 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:14.604098 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:14.605328 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:14.612634 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.613394 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.614575 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:14.615196 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:14.681881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0332da68-d429-432a-a260-e015b658f021 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: .version_select at 0x7f21ed278c10>, body: {"keypair": {"name": "tempest-keypair-1454532927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLz41fVs6i8vOIny3CyqK5VV8QM416uJcKNJrpZ14ICproRrbM9HPQ2cp3vc7NOLtr3EG1dyzlyvsqRNEWZEuFIn8uWS8nu1CL3lECpIOkRKH/qr3t+uZI9+iNxeiEy8gQ=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:14.696838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-0332da68-d429-432a-a260-e015b658f021 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:14.700907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-0332da68-d429-432a-a260-e015b658f021 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for user e1516d2903414b7caf082c32dcdac3eb and project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:14.724465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0332da68-d429-432a-a260-e015b658f021 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046562 Jun 20 06:14:14.725122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 207/414] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:14:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:14:14.780942 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:14.789873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1230485b-0dc8-4737-a31c-a1543e83523b tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1313 microversion: 2.1 time: 0.191258 Jun 20 06:14:14.800067 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 208/415] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:14 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1313 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:15.807640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:15.808953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:15.816626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.817126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.817914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:15.818506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:15.960385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:15.968282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2144a64a-4795-4a8d-89d6-51f788ba197e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1497 microversion: 2.1 time: 0.165148 Jun 20 06:14:15.969717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 208/416] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:15 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:16.006202 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-123040334", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8b635499-8a2a-42bc-ac0e-c70a56c04e1f"}], "security_groups": [{"name": "tempest-securitygroup--652561810"}], "key_name": "tempest-keypair-1454532927", "user_data": "}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:16.106536 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.network.neutron [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] validate_networks() for [('8b635499-8a2a-42bc-ac0e-c70a56c04e1f', None, None, None, None, None)] {{(pid=117586) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:16.469421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:16.470226 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image limits 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:16.470968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Flavor pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:16.471597 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Image pref 0:0:0 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:16.472138 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.virt.hardware [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117586) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:16.481365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.481822 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.482632 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:16.483075 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:16.501821 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:16.506001 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Getting quotas for user e1516d2903414b7caf082c32dcdac3eb and project 9f7a1ff44e2a455ba4260b74ae06b50c. Resources: {'instances', 'cores', 'ram'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:16.518785 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Going to run 1 instances... {{(pid=117586) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:16.521604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117586) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:16.572182 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-df1d1fa9-c98b-4c5b-85c9-45b7f55e2a0f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.570110 Jun 20 06:14:16.572775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 209/417] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:16 2022] POST /compute/v2.1/servers => generated 408 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:16.584332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cb7482c9-4d0c-4d17-92ee-0cfe6a0052bc tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:16.584971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cb7482c9-4d0c-4d17-92ee-0cfe6a0052bc tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:16.647973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cb7482c9-4d0c-4d17-92ee-0cfe6a0052bc tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:16.654800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cb7482c9-4d0c-4d17-92ee-0cfe6a0052bc tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1245 microversion: 2.1 time: 0.076009 Jun 20 06:14:16.655571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 209/418] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:16 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1245 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:17.671069 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:17.671681 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:17.678337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.678790 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.679546 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:17.679979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:17.750941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:17.758287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bf4ee587-db4e-45ab-91c8-f28fffab441a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1249 microversion: 2.1 time: 0.091114 Jun 20 06:14:17.758845 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 210/419] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:17 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:18.774872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:18.775494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:18.781991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.782450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.783223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:18.783669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:18.843711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:18.851893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a9dc5a06-56c2-4b85-bec2-240bef91f422 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1249 microversion: 2.1 time: 0.080846 Jun 20 06:14:18.852458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 210/420] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:18 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:19.869194 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.869804 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.875946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.876465 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.877890 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.879012 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.960089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:19.960614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:19.966287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:19.969229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.969791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.971311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:19.972865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:19.980910 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-41f1cec2-8438-4e27-9b86-fd43b75094d3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1241 microversion: 2.1 time: 0.110133 Jun 20 06:14:19.980910 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 211/421] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:19 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1241 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:20.000911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:14:20.081215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b4007054-5258-4599-b8bf-dd820c98f605 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 204 len: 0 microversion: 2.1 time: 0.125631 Jun 20 06:14:20.081799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 211/422] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:19 2022] DELETE /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:14:20.090610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:20.090610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:20.097702 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.098161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.098928 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:20.099372 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:20.231278 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:20.239067 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-39a918ea-0823-4a57-9659-c100e82a98c2 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.152888 Jun 20 06:14:20.239877 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 212/423] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:20 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:20.993791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:20.994506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:21.001509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.002022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.002830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.003267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.072219 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:21.080847 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d02ab940-5757-42e7-83d7-1d52bd340cbd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1297 microversion: 2.1 time: 0.090468 Jun 20 06:14:21.081573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 212/424] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:20 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:21.257064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:21.257610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:21.263566 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.264023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.264823 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:21.265267 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:21.392173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:21.400191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-5fb9e392-8187-45d2-8381-10f982d04dfb tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.147165 Jun 20 06:14:21.400869 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 213/425] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:21 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.097402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.098014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.104423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.104962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.107143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.107882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.175679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:22.183141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-30aaed5e-b2fa-48b0-baab-3abfcfccf3f5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1297 microversion: 2.1 time: 0.089632 Jun 20 06:14:22.183701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 213/426] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1297 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:22.418177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:22.418720 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:22.425492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.425952 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.426717 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:22.427160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:22.553618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:22.561017 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-49958b3c-0026-449e-8be4-8f040373ac03 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.146712 Jun 20 06:14:22.561581 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 214/427] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:22 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:23.199159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:23.199803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:23.207236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.207694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.208473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.208955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.269522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:23.276748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-44e3d2dc-7b95-4d1c-b871-c382237eae07 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1297 microversion: 2.1 time: 0.081342 Jun 20 06:14:23.277322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 214/428] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:23 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1297 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:23.577753 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:23.578362 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:23.584919 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.585369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.586124 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:23.586559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:23.719468 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:23.727464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ab439b57-a493-44c1-b651-a9b2d972ff96 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.153574 Jun 20 06:14:23.728029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 215/429] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:23 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:24.293822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:24.294557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:24.301669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.302129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.302900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.303339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.366233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:24.373651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0fc6fcf5-817e-4b30-ae8e-9dc056cccc17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1297 microversion: 2.1 time: 0.083666 Jun 20 06:14:24.374212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 215/430] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:24 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:24.745567 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:24.746185 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:24.752958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.753409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.754193 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:24.754630 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:24.879645 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:24.887892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d08fbb6a-678c-4d0c-b39c-799f148d72c5 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.146083 Jun 20 06:14:24.888443 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 216/431] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:24 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:25.390227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:25.390864 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:25.397540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.397991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.398782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.399212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.463639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:25.471716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e052b0d2-8b71-4adb-aec4-da3597c4cf69 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1297 microversion: 2.1 time: 0.085659 Jun 20 06:14:25.472283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 216/432] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:25 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1297 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:25.907647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:25.909630 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:25.916575 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.917211 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:25.918268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:25.918922 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.152042 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:26.160576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-749b6bec-cdd7-4ae9-8b1b-f2c90a9d3318 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.258559 Jun 20 06:14:26.161517 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 217/433] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:25 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:26.490420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:26.492003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:26.497593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:26.498074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.498850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:26.499292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:26.575897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:26.584220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a2d33793-4508-4529-860e-b6e723070bf2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1303 microversion: 2.1 time: 0.099625 Jun 20 06:14:26.584816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 217/434] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:26 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:27.177387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=2 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.179333 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=6 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.183630 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:27.184847 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:27.195191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.195915 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.196911 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.197511 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.601664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:27.602342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:27.604443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:27.613218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.613667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.614615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:27.615232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:27.787842 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:27.816920 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0356eb6e-823c-404c-86cc-6b97d878f5fc tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1503 microversion: 2.1 time: 0.637886 Jun 20 06:14:27.817939 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 218/435] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:27 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1503 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:27.937288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:27.950214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3d116d97-53dc-4847-953b-e8f75dd3084f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.352365 Jun 20 06:14:27.950810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 218/436] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:27 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:28.112094 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-568e6346-660e-4c06-92dc-08e06d0a50a2 req-fdeb3d7a-3829-409a-8fda-6182356ce29e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:28.124997 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-568e6346-660e-4c06-92dc-08e06d0a50a2 req-fdeb3d7a-3829-409a-8fda-6182356ce29e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.125654 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-568e6346-660e-4c06-92dc-08e06d0a50a2 req-fdeb3d7a-3829-409a-8fda-6182356ce29e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.141162 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-568e6346-660e-4c06-92dc-08e06d0a50a2 req-fdeb3d7a-3829-409a-8fda-6182356ce29e service nova] Creating event network-changed:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:14:28.147600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-568e6346-660e-4c06-92dc-08e06d0a50a2 req-fdeb3d7a-3829-409a-8fda-6182356ce29e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040093 Jun 20 06:14:28.152320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 219/437] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:28.204871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-288ad3ed-8af8-4476-8920-b511601c0c12 req-8d011037-e3fd-4ebe-b4ef-ebcf7ad7b8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4acf1d44-a2c5-4202-8142-ddc48b0bddab", "name": "network-vif-deleted", "tag": "6d4ddb4a-83c4-49f2-aa8f-b1b15c436285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:28.216642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-288ad3ed-8af8-4476-8920-b511601c0c12 req-8d011037-e3fd-4ebe-b4ef-ebcf7ad7b8f2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.218087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-288ad3ed-8af8-4476-8920-b511601c0c12 req-8d011037-e3fd-4ebe-b4ef-ebcf7ad7b8f2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.236617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-288ad3ed-8af8-4476-8920-b511601c0c12 req-8d011037-e3fd-4ebe-b4ef-ebcf7ad7b8f2 service nova] Creating event network-vif-deleted:6d4ddb4a-83c4-49f2-aa8f-b1b15c436285 for instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab on hv-cinder-80403 Jun 20 06:14:28.244007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-288ad3ed-8af8-4476-8920-b511601c0c12 req-8d011037-e3fd-4ebe-b4ef-ebcf7ad7b8f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042614 Jun 20 06:14:28.244993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 219/438] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:28.836176 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:28.837776 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:28.844784 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.845688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.847929 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.849435 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.897678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.898365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.899144 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.objects.instance [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lazy-loading 'fault' on Instance uuid 4acf1d44-a2c5-4202-8142-ddc48b0bddab {{(pid=117586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:28.958046 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:28.966453 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-75d0ef83-2ffa-4cbd-842b-3f795fa459ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 200 len: 1303 microversion: 2.1 time: 0.135817 Jun 20 06:14:28.967284 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 220/439] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:28 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 1303 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:28.978791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:28.979889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:28.990322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.990322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:28.990322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:28.990322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.148363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:29.156440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cf120411-85b9-4b75-9586-b2fc3f8b7323 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.192573 Jun 20 06:14:29.157044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 220/440] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:28 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:29.988734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:29.989439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 4acf1d44-a2c5-4202-8142-ddc48b0bddab] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:29.995621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.996110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:29.997104 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:29.997563 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.001774 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:30.011947 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] HTTP exception thrown: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Request method failure captured: Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab HTTP/1.1 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisBAUGmJJBUXr8hsKRRDKtPIjjemBGm1V5gy1TlgfS_2vF0YCH-jEFlKhp5ySBnGx54Zfh_eLZb6tNI9hShi6w9t-EKEaqkM_jdLEAqMArUj8G-tBMWvdO7nVfNxrhwhUVkHD7KHZcQKIFvDjwruSAb85K6Lbd0UWAH8xPCNVsqPjkt8 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: b38a00f3ffb54dafae0998b26c2478a1 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:14:30.013622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b38a00f3ffb54dafae0998b26c2478a1"}]}] Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: b38a00f3ffb54dafae0998b26c2478a1 Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesActionsTest-1809393398-project Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 308284e2c67341d181eac71cf19f92c6 Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesActionsTest-1809393398-project Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: > Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. Jun 20 06:14:30.015132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': '4acf1d44-a2c5-4202-8142-ddc48b0bddab'} Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:30.016029 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. Jun 20 06:14:30.017609 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:30.020174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Returning 404 to user: Instance 4acf1d44-a2c5-4202-8142-ddc48b0bddab could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:30.020174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-216b3b2d-aa0b-4ed5-946d-26af4a009e56 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab" status: 404 len: 111 microversion: 2.1 time: 0.031662 Jun 20 06:14:30.020174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 221/441] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:29 2022] GET /compute/v2.1/servers/4acf1d44-a2c5-4202-8142-ddc48b0bddab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:14:30.117596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1236838439", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "networks": [{"uuid": "d370b089-abad-4168-bc79-e0225529316a"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:30.170809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] validate_networks() for [('d370b089-abad-4168-bc79-e0225529316a', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:30.175400 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.176032 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.182109 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.182577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.183355 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.183798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.403901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:30.413787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-af1e500d-0e90-4738-bb78-1bf224dec78d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.242186 Jun 20 06:14:30.414421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 222/442] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:30 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:30.671596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:30.672026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:30.672498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:30.672952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:30.673373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:30.683650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.684104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.684943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:30.685385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:30.703888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Getting quotas for project b38a00f3ffb54dafae0998b26c2478a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:30.708756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Getting quotas for user 308284e2c67341d181eac71cf19f92c6 and project b38a00f3ffb54dafae0998b26c2478a1. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:30.722126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:30.724552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:30.775450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e80ef1f9-c6ac-47ac-aaff-7a0a529c2314 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661525 Jun 20 06:14:30.776539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 221/443] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:30.786979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7c3e965e-10ba-4752-aae8-94735b1210ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:30.787813 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7c3e965e-10ba-4752-aae8-94735b1210ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:30.852118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7c3e965e-10ba-4752-aae8-94735b1210ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:30.860583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7c3e965e-10ba-4752-aae8-94735b1210ab tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1214 microversion: 2.1 time: 0.078147 Jun 20 06:14:30.865135 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 223/444] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:30 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:31.433160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:31.433780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:31.443038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.443624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.444590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.445213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.626987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:31.642950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5b6e942e-58b5-4bdd-9ef2-0b24af766e92 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.213344 Jun 20 06:14:31.645971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 222/445] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:31 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:31.878346 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:31.879881 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:31.890085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.890559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:31.892501 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:31.893862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.006332 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:32.014171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-fa359c81-d7ca-4da0-aa0e-8a938e66869c tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1218 microversion: 2.1 time: 0.139992 Jun 20 06:14:32.015121 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 224/446] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:31 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1218 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:32.664595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:32.666102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:32.676539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.677483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.679767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:32.680594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:32.849157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:32.857457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1e41addd-fdd2-4e5f-be76-e6f16d8b129a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.199967 Jun 20 06:14:32.858013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 223/447] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:32 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:33.031220 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:33.032576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:33.039623 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.040369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.041411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.042073 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.114647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:33.122885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c5e5ab80-2030-4bd0-8813-00c25fb570a6 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1272 microversion: 2.1 time: 0.095289 Jun 20 06:14:33.123558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 225/448] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:33 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1272 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:33.433715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2053231556", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "networks": [{"uuid": "c530370a-2c4e-48a4-9c47-3aa1262db8e3"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:33.490098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] validate_networks() for [('c530370a-2c4e-48a4-9c47-3aa1262db8e3', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:14:33.877412 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:33.878489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:33.885961 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.887669 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:33.888677 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:33.890562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.056349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:14:34.056860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:14:34.057326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:14:34.057768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:14:34.058187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:14:34.069715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.070168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.071231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.071741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.092045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Getting quotas for project 32eaa17777d1483ebf99b417ca9ad0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:34.097075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Getting quotas for user b6cafb20423142db91fcca21cd19ff7d and project 32eaa17777d1483ebf99b417ca9ad0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:34.111054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:14:34.113922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:14:34.157832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:34.173762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e0cfc476-27cb-474e-ac14-71af8eecf3d3 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.743897 Jun 20 06:14:34.182863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 224/449] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:14:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 754 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:14:34.193921 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-996694ab-af57-4b23-954b-ee3db61039b2 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.297932 Jun 20 06:14:34.197489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 226/450] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:33 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:34.203612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:34.205027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:34.210001 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e929a110-52b3-40be-aba4-227f44890c17 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:34.211767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e929a110-52b3-40be-aba4-227f44890c17 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:34.214030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.214684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.215631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.216244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.223091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.324421 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e929a110-52b3-40be-aba4-227f44890c17 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:34.332268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e929a110-52b3-40be-aba4-227f44890c17 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1219 microversion: 2.1 time: 0.133516 Jun 20 06:14:34.334423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 227/451] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:34 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1219 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:34.428893 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-dc278e75-05f2-46cd-ad03-7684ab3ccc0c req-f313d124-7933-4e03-9ccb-afdae6d560ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "178dbf74-8dd9-443a-b1b5-ecc705fe0ebd", "tag": "838b910a-1cbe-4376-a944-fb769f0ec654"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:34.434788 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:34.473330 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-dc278e75-05f2-46cd-ad03-7684ab3ccc0c req-f313d124-7933-4e03-9ccb-afdae6d560ea service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:34.473991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-dc278e75-05f2-46cd-ad03-7684ab3ccc0c req-f313d124-7933-4e03-9ccb-afdae6d560ea service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:34.496353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-dc278e75-05f2-46cd-ad03-7684ab3ccc0c req-f313d124-7933-4e03-9ccb-afdae6d560ea service nova] Creating event network-changed:838b910a-1cbe-4376-a944-fb769f0ec654 for instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd on hv-cinder-80403 Jun 20 06:14:34.513077 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-dc278e75-05f2-46cd-ad03-7684ab3ccc0c req-f313d124-7933-4e03-9ccb-afdae6d560ea service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089434 Jun 20 06:14:34.516835 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 228/452] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:14:34.519544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:34.528818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-846f4822-a81e-4db5-ab11-e9746a205a13 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.344105 Jun 20 06:14:34.529400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 225/453] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:34 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:35.216007 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:35.218147 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:35.225995 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.226447 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.227937 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.228438 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.351258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:35.351776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:35.374048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.374511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.375280 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.376244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.458826 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:35.468499 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c2e90f39-e70a-4c20-9830-a9526140b22e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.256666 Jun 20 06:14:35.474671 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 229/454] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:35 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:35.491793 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-6ea6a921-ba23-4a5d-8642-076a0e13c792 req-9ff52cd0-e5e2-448e-8ab6-77a74e7393f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "name": "network-vif-plugged", "status": "completed", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:35.525007 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-6ea6a921-ba23-4a5d-8642-076a0e13c792 req-9ff52cd0-e5e2-448e-8ab6-77a74e7393f1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.525660 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-6ea6a921-ba23-4a5d-8642-076a0e13c792 req-9ff52cd0-e5e2-448e-8ab6-77a74e7393f1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.563285 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-6ea6a921-ba23-4a5d-8642-076a0e13c792 req-9ff52cd0-e5e2-448e-8ab6-77a74e7393f1 service nova] Creating event network-vif-plugged:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:14:35.570548 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-6ea6a921-ba23-4a5d-8642-076a0e13c792 req-9ff52cd0-e5e2-448e-8ab6-77a74e7393f1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085424 Jun 20 06:14:35.571623 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 230/455] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:35.582131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:35.583898 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:35.595679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:35.611268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cfd56650-36ea-41ba-adee-7cf9354e818b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1271 microversion: 2.1 time: 0.264538 Jun 20 06:14:35.612309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 226/456] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:35 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1271 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:35.614191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.617152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.619857 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:35.620418 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:35.850606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:35.858844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7850dfb5-0747-47b7-a04e-3dcd9d154d50 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.285593 Jun 20 06:14:35.859699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 231/457] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:35 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:36.491014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.491625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.498385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.498582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.499564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.499773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.629915 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.632284 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.648254 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.648738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.649552 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.650009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.660350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:36.671936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-908a9ac3-c7a4-4eef-a2a1-e2049299b2f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.185713 Jun 20 06:14:36.683688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 227/458] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:36 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:36.753724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:36.762475 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-984f2370-c2d4-493b-838b-2c2de3026f44 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1277 microversion: 2.1 time: 0.136861 Jun 20 06:14:36.763684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 232/459] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:36 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:36.877845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:36.878472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:36.884926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.886024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:36.887132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:36.887876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.046275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:37.055587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a8ab7f56-85c1-4169-b650-f283e52459a9 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.181924 Jun 20 06:14:37.056182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 228/460] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:36 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:37.693364 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:37.694968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:37.702628 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.703086 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.704050 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.704655 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.781394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:37.782012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:37.789861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.790604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.792121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:37.792567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:37.891969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:37.907933 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:37.911745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-15472ab8-dc29-43dd-a877-36dccda6e75e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1277 microversion: 2.1 time: 0.134089 Jun 20 06:14:37.912925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 229/461] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:37 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1277 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:37.918196 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-dc7fa9e5-eee6-4eda-9442-9d5204790b48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.230626 Jun 20 06:14:37.920199 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 233/462] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:37 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:38.073613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.074375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.076611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:38.084449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.084933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.085846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.086299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.234573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:38.248534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-767a3615-1035-439c-acbe-ed3c8f71c91e tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.179209 Jun 20 06:14:38.249379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 230/463] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:38.929335 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.930641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.937733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:38.938352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:38.938783 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.940079 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.941561 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.942177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.947941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.948397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:38.949212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:38.949648 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.092641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:39.107353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0eefa5e0-c184-4c03-9314-f66c29e6171d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1277 microversion: 2.1 time: 0.183140 Jun 20 06:14:39.115070 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 234/464] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1277 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:39.257094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:39.266185 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:39.266832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:39.270686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0d8d719c-ae3a-4cc0-b0c9-322b4c8ee30b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.338907 Jun 20 06:14:39.271496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 231/465] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:38 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:39.296178 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.296659 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.297560 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:39.297998 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:39.672670 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:39.682577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b80c7f33-6573-441f-93b0-6bb4663d096d tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.420112 Jun 20 06:14:39.683313 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 235/466] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:39 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:40.132937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:40.133606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:40.140050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.140506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.141333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.141983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.198656 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:14:40.199139 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:14:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:14:40.290973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:40.292280 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:40.305811 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.307024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.308208 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.309009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.451483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:40.463542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-be04c79e-a016-4296-9f87-f857ba015e13 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.336180 Jun 20 06:14:40.475940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 232/467] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:40 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:40.595627 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:40.603710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2386c2e5-9161-48d2-a412-12cfd8728cf7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1370 microversion: 2.1 time: 0.318392 Jun 20 06:14:40.614080 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 236/468] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:40 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1370 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:40.700048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:40.700663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:40.711083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.711877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:40.713073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:40.713732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.063881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:41.077228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d465dae0-96fc-4568-915b-db6c42d368c0 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.381272 Jun 20 06:14:41.080885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 233/469] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:40 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:41.398556 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-32f6a382-670d-4f57-b9cf-449e11ac0352 req-a91b6da1-fb38-4918-a42f-32d259c2f4ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67e2ba1e-49da-4f92-b169-de4528a1a15f", "tag": "10ea133d-eff8-4339-89bd-603b9576d4cb"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:41.412725 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-32f6a382-670d-4f57-b9cf-449e11ac0352 req-a91b6da1-fb38-4918-a42f-32d259c2f4ef service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:41.417251 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-32f6a382-670d-4f57-b9cf-449e11ac0352 req-a91b6da1-fb38-4918-a42f-32d259c2f4ef service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.445416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-32f6a382-670d-4f57-b9cf-449e11ac0352 req-a91b6da1-fb38-4918-a42f-32d259c2f4ef service nova] Creating event network-changed:10ea133d-eff8-4339-89bd-603b9576d4cb for instance 67e2ba1e-49da-4f92-b169-de4528a1a15f on hv-cinder-80403 Jun 20 06:14:41.455850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-32f6a382-670d-4f57-b9cf-449e11ac0352 req-a91b6da1-fb38-4918-a42f-32d259c2f4ef service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063012 Jun 20 06:14:41.457275 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 237/470] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:41.483019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:41.483019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:41.508287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:41.508776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.509581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:41.510027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.620855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:41.621818 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:41.633592 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:41.634057 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.634850 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:41.638368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:41.983837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:41.997345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6e290d54-4828-46ef-be94-8be22012b324 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.519569 Jun 20 06:14:41.998909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 234/471] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:41 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:42.013386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-528a75ef-028f-4a69-901a-1d8ac23f1c93 req-f7f8b2dd-4333-4dfc-8c5e-2ef5f7633314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178dbf74-8dd9-443a-b1b5-ecc705fe0ebd", "name": "network-vif-plugged", "status": "completed", "tag": "838b910a-1cbe-4376-a944-fb769f0ec654"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:42.023287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-528a75ef-028f-4a69-901a-1d8ac23f1c93 req-f7f8b2dd-4333-4dfc-8c5e-2ef5f7633314 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:42.024813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-528a75ef-028f-4a69-901a-1d8ac23f1c93 req-f7f8b2dd-4333-4dfc-8c5e-2ef5f7633314 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:42.034703 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:42.038407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-528a75ef-028f-4a69-901a-1d8ac23f1c93 req-f7f8b2dd-4333-4dfc-8c5e-2ef5f7633314 service nova] Creating event network-vif-plugged:838b910a-1cbe-4376-a944-fb769f0ec654 for instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd on hv-cinder-80403 Jun 20 06:14:42.044572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-528a75ef-028f-4a69-901a-1d8ac23f1c93 req-f7f8b2dd-4333-4dfc-8c5e-2ef5f7633314 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042085 Jun 20 06:14:42.045129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8d99af81-bee7-4fc4-92f4-9e3c5cda373a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1565 microversion: 2.1 time: 0.428407 Jun 20 06:14:42.045702 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 238/472] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:41 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1565 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:42.053558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 235/473] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:42.062127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:42.062641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:42.069659 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:42.070113 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:42.071786 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:42.073236 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:42.097910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:42.099120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:42.108749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:42.115684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:42.117302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:42.117980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:42.402832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-3282e11b-822e-4b3f-8e0b-239a20df9365 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.344722 Jun 20 06:14:42.410444 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 239/474] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:14:42 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-interface => generated 285 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:42.671203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:42.681089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0a43248b-6a9b-4bbc-9af4-d89051bea3fe tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.589528 Jun 20 06:14:42.687524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 236/475] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:42 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:43.014967 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:43.015590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:43.027306 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:43.027718 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:43.028516 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:43.028980 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:43.567169 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:43.577699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-545ed318-637a-4bf8-8416-e36e00dbd8bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.566568 Jun 20 06:14:43.580217 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 240/476] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:43 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:43.705149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:43.706583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:43.717412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:43.720352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:43.721694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:43.723497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:44.081580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:44.106960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=12 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:44.343186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:44.352741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f38a3c93-a86e-4c18-975f-b7abe9d0ab23 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.652949 Jun 20 06:14:44.354218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 237/477] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:43 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:44.496249 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-e6c64b10-3cba-4588-acbc-31969b1e0dad req-6e257c2d-7bba-4941-bbb2-fbc8ad178039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:44.504719 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=4 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:44.506981 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-e6c64b10-3cba-4588-acbc-31969b1e0dad req-6e257c2d-7bba-4941-bbb2-fbc8ad178039 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:44.507622 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-e6c64b10-3cba-4588-acbc-31969b1e0dad req-6e257c2d-7bba-4941-bbb2-fbc8ad178039 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:44.523369 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-e6c64b10-3cba-4588-acbc-31969b1e0dad req-6e257c2d-7bba-4941-bbb2-fbc8ad178039 service nova] Creating event network-changed:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:14:44.531378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-e6c64b10-3cba-4588-acbc-31969b1e0dad req-6e257c2d-7bba-4941-bbb2-fbc8ad178039 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037960 Jun 20 06:14:44.532301 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 241/478] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:44.599155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:44.600051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:44.607061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:44.608174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:44.609770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:44.610807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:44.786797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:44.797824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9d25bd45-168d-458c-8cb7-937d79376f58 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.206018 Jun 20 06:14:44.810474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 238/479] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:44 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:45.370761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:45.371833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:45.379368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:45.380092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:45.381073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:45.381669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:45.655260 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-f9dfac18-66a4-4488-913d-ec66d9d18fb6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Action: 'create', calling method: .version_select at 0x7f21edac8160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1814282609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBqeKlSqiEyrT1k2GeSQWA1TlOdbZqWF/hfbjadNN+min3h34iqKkXP1QT7UpWQfWLV3oCFl6EDT1DLXoYiUjoRC1IJUYEfsFHm5/U98Wi5niaPCL53NpIsh3Hl5LCoQwA=="}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:45.678437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:45.682781 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-f9dfac18-66a4-4488-913d-ec66d9d18fb6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for project 7bcde2f2809247979837902b91d6a6cb. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:14:45.686613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-32d25eaf-1f8c-43c7-9fea-c58aa22d9012 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.319636 Jun 20 06:14:45.687224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-f9dfac18-66a4-4488-913d-ec66d9d18fb6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for user b19967e2b09342e9ac006151002bf71a and project 7bcde2f2809247979837902b91d6a6cb. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:14:45.699671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 239/480] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:45 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:45.719304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f9dfac18-66a4-4488-913d-ec66d9d18fb6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.425629 Jun 20 06:14:45.719911 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 242/481] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:14:45 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:45.816856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:45.818057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:45.825953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:45.826428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:45.827198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:45.827867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:46.186711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:46.202467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-51ca87c9-4d50-4e1d-bb68-4610f5025054 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.390071 Jun 20 06:14:46.211987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 240/482] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:45 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:46.705816 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:46.707273 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:46.714231 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:46.715005 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:46.716125 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:46.716671 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:47.058650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:47.068005 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-83bf0558-8a04-4d2b-aa93-5203f2bbf11f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1314 microversion: 2.1 time: 0.366878 Jun 20 06:14:47.070356 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 243/483] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:46 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:47.224844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:47.225881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:47.239502 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:47.240961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:47.242191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:47.242916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:47.442330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:47.456816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-33a3bda2-2268-4a81-9551-bb4fd0090ac5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.238266 Jun 20 06:14:47.457825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 241/484] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:47 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:48.086640 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:48.087255 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:48.093618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.094142 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.094897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.096242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.111596 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:48.232770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:48.241024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-fd65b304-eff2-48fa-8f9f-ec3f335b1077 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1499 microversion: 2.1 time: 0.158242 Jun 20 06:14:48.241600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 244/485] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:48 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:48.473690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:48.474382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:48.483265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.483719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.484764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.485206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.502702 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:14:48.633775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:48.641136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa55f33a-abd7-44f5-9723-3c23d748e29a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.171492 Jun 20 06:14:48.641701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 242/486] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:48 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:48.863076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:48.863572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:48.869537 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.869988 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.870741 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.871208 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.895562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Going to try to terminate instance {{(pid=117586) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:14:48.977122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-894fce17-d5d3-4e7a-9ac8-4ee52d64cd65 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "DELETE /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 204 len: 0 microversion: 2.1 time: 0.117641 Jun 20 06:14:48.977931 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 245/487] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:14:48 2022] DELETE /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:14:48.987720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:48.988364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:48.994488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.994884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:48.995647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:48.996081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:49.146793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:49.155141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-76727399-0a41-4ef3-b856-b1abdc9a9302 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1505 microversion: 2.1 time: 0.172759 Jun 20 06:14:49.155740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 243/488] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:48 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1505 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:49.626153 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-71bc3acd-b1e2-4e6b-9d74-404301e2b164 req-f891321b-7f8f-4160-b787-fb3e326bf810 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e2ba1e-49da-4f92-b169-de4528a1a15f", "name": "network-vif-plugged", "status": "completed", "tag": "10ea133d-eff8-4339-89bd-603b9576d4cb"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:49.636055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-71bc3acd-b1e2-4e6b-9d74-404301e2b164 req-f891321b-7f8f-4160-b787-fb3e326bf810 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:49.636509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-71bc3acd-b1e2-4e6b-9d74-404301e2b164 req-f891321b-7f8f-4160-b787-fb3e326bf810 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:49.648273 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-71bc3acd-b1e2-4e6b-9d74-404301e2b164 req-f891321b-7f8f-4160-b787-fb3e326bf810 service nova] Creating event network-vif-plugged:10ea133d-eff8-4339-89bd-603b9576d4cb for instance 67e2ba1e-49da-4f92-b169-de4528a1a15f on hv-cinder-80403 Jun 20 06:14:49.653596 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-71bc3acd-b1e2-4e6b-9d74-404301e2b164 req-f891321b-7f8f-4160-b787-fb3e326bf810 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031577 Jun 20 06:14:49.654746 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 246/489] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:49.658821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:49.659523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:49.665868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:49.666320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:49.667091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:49.667527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:49.803569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:49.810946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c669be3e-da73-4b23-88ea-15eb71376254 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.156366 Jun 20 06:14:49.811540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 244/490] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:49 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:14:50.172932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:50.174425 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:50.180581 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:50.181072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:50.181829 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:50.182282 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:50.317191 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:50.324836 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-72054f40-908e-47f3-ac4f-8f9dde9a74a4 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1505 microversion: 2.1 time: 0.156082 Jun 20 06:14:50.325482 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 247/491] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:50 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:50.830679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:50.833099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:50.841147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:50.841932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:50.842880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:50.843480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:51.004095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:51.012596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f5d158c5-9ec9-45c7-b6d7-6aa9879ff9bc tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.188232 Jun 20 06:14:51.018128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 245/492] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:50 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:51.342766 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:51.343532 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:51.350584 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:51.351201 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:51.351993 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:51.352439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:51.493229 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:51.501011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c67c10bb-f9a1-4073-860b-8d78d6b529be tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1505 microversion: 2.1 time: 0.162241 Jun 20 06:14:51.502329 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 248/493] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:51 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:52.030297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:52.030984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:52.039216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:52.039886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:52.040772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:52.041289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:52.171338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:52.179214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-51d4f5a7-036c-498a-8cac-ca7eab014659 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1319 microversion: 2.1 time: 0.152798 Jun 20 06:14:52.179774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 246/494] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:52 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:52.519916 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:52.520655 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:52.526961 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:52.527559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:52.528459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:52.529030 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:52.739712 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:52.747454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d55a0aee-808e-4c64-818e-419103fca6ce tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1505 microversion: 2.1 time: 0.232267 Jun 20 06:14:52.748071 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 249/495] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:52 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1505 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:52.903647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-ab8c461d-ca95-4abf-8e69-e626a5515177 req-6e9c2179-e5a6-4b2f-a708-421ba063287b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "178dbf74-8dd9-443a-b1b5-ecc705fe0ebd", "name": "network-vif-deleted", "tag": "838b910a-1cbe-4376-a944-fb769f0ec654"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:14:52.913568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ab8c461d-ca95-4abf-8e69-e626a5515177 req-6e9c2179-e5a6-4b2f-a708-421ba063287b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:52.914012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ab8c461d-ca95-4abf-8e69-e626a5515177 req-6e9c2179-e5a6-4b2f-a708-421ba063287b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:52.931496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-ab8c461d-ca95-4abf-8e69-e626a5515177 req-6e9c2179-e5a6-4b2f-a708-421ba063287b service nova] Creating event network-vif-deleted:838b910a-1cbe-4376-a944-fb769f0ec654 for instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd on hv-cinder-80403 Jun 20 06:14:52.936662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-ab8c461d-ca95-4abf-8e69-e626a5515177 req-6e9c2179-e5a6-4b2f-a708-421ba063287b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037664 Jun 20 06:14:52.937284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 247/496] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:14:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:14:53.195410 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:53.195950 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:53.201973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:53.202431 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:53.203201 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:53.203646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:53.345803 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:53.355796 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a6010b4e-29d2-46bd-8ed4-bb1c907fba07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1509 microversion: 2.1 time: 0.164236 Jun 20 06:14:53.356636 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 250/497] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:53 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:53.767757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:53.768885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:53.776432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:53.776881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:53.777849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:53.778540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:53.817585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:53.818049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:53.818508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lazy-loading 'fault' on Instance uuid 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:14:53.863499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '308284e2c67341d181eac71cf19f92c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b38a00f3ffb54dafae0998b26c2478a1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:14:53.872944 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b285c785-761d-4dff-bbfe-a34eaee0589f tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 200 len: 1304 microversion: 2.1 time: 0.110313 Jun 20 06:14:53.873525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 248/498] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:53 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:14:54.890874 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:14:54.891503 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] [instance: 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:14:54.898141 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:54.898757 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:54.899500 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:14:54.899950 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:14:54.915752 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.wsgi [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] HTTP exception thrown: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Request method failure captured: Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: request: GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd HTTP/1.1 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept: application/json Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Accept-Encoding: identity Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Connection: close Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Length: 0 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Content-Type: application/json Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Host: 10.222.0.39 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Openstack-System-Scope: None Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: User-Agent: python-urllib3/1.26.9 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Auth-Token: gAAAAABisBAUGmJJBUXr8hsKRRDKtPIjjemBGm1V5gy1TlgfS_2vF0YCH-jEFlKhp5ySBnGx54Zfh_eLZb6tNI9hShi6w9t-EKEaqkM_jdLEAqMArUj8G-tBMWvdO7nVfNxrhwhUVkHD7KHZcQKIFvDjwruSAb85K6Lbd0UWAH8xPCNVsqPjkt8 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Id: None Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Domain-Name: None Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Identity-Status: Confirmed Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Is-Admin-Project: True Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Id: default Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Domain-Name: Default Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Id: b38a00f3ffb54dafae0998b26c2478a1 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Project-Name: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Role: reader,member Jun 20 06:14:54.917462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Roles: reader,member Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b38a00f3ffb54dafae0998b26c2478a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/b38a00f3ffb54dafae0998b26c2478a1"}]}] Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Id: b38a00f3ffb54dafae0998b26c2478a1 Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-Tenant-Name: tempest-VolumesActionsTest-1809393398 Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User: tempest-VolumesActionsTest-1809393398-project Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Id: default Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Domain-Name: Default Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Id: 308284e2c67341d181eac71cf19f92c6 Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: X-User-Name: tempest-VolumesActionsTest-1809393398-project Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: method: > Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: exception: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. Jun 20 06:14:54.919085 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: action_args: {'id': '178dbf74-8dd9-443a-b1b5-ecc705fe0ebd'} Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:14:54.920103 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. Jun 20 06:14:54.921614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: ERROR nova.api.openstack.wsgi Jun 20 06:14:54.922846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] Returning 404 to user: Instance 178dbf74-8dd9-443a-b1b5-ecc705fe0ebd could not be found. {{(pid=117586) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:14:54.922846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-236c8b7a-b5ff-419c-b81d-516d564d36f1 tempest-VolumesActionsTest-1809393398 tempest-VolumesActionsTest-1809393398-project] 10.222.0.39 "GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd" status: 404 len: 111 microversion: 2.1 time: 0.031949 Jun 20 06:14:54.922846 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 251/499] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:14:54 2022] GET /compute/v2.1/servers/178dbf74-8dd9-443a-b1b5-ecc705fe0ebd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:15:10.627509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:10.628070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:10.631154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=39 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:10.631806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=37 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:10.637464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.637909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.638675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:10.639111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:10.663457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-74ed39bd-b521-4c0f-9faa-66e8604fedcf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/ips" status: 200 len: 152 microversion: 2.20 time: 0.039794 Jun 20 06:15:10.664014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 249/500] 10.222.0.39 () {60 vars in 1288 bytes} [Mon Jun 20 06:15:10 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:15:14.242257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:14.242955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:14.244847 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=4 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.245718 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.246414 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:14.252958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.253411 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.254218 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:14.254816 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:14.281459 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.objects.instance [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lazy-loading 'flavor' on Instance uuid 7a94bb25-2c14-43f3-91a3-1f75da735166 {{(pid=117586) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:15:19.543264 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-73c7fb5c-83bd-4065-bb27-84f76b5d6b82 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/action" status: 202 len: 0 microversion: 2.20 time: 5.304986 Jun 20 06:15:19.544286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 252/501] 10.222.0.39 () {62 vars in 1318 bytes} [Mon Jun 20 06:15:14 2022] POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/action => generated 0 bytes in 5307 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:15:19.556255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:19.557318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:19.565081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.565765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.566961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:19.567645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:19.705932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:19.715462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:19.717159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:19.718399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9bcc4927-09c7-424f-adaf-64c8f261df74 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.170458 Jun 20 06:15:19.719194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 250/502] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:19 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:20.739946 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:20.740692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:20.747072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.747530 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.748301 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:20.748772 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:20.878002 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:20.886138 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:20.887647 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:20.888854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-fb294ad2-d9ee-44a0-83a8-400db024517b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.153867 Jun 20 06:15:20.889417 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 253/503] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:20 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:21.922397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:21.922397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:21.922397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.922397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:21.923731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:21.923731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:22.063762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:22.073261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:22.074871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:22.076381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-373beb88-28d4-4e46-ba7e-79a414d773d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.173290 Jun 20 06:15:22.077126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 251/504] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:21 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:23.095368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:23.097503 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:23.103973 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.104684 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.105590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:23.106110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:23.244298 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:23.253416 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:23.255295 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:23.256682 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a4759e0d-d3a8-4098-9989-5667fb7aba6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.165098 Jun 20 06:15:23.268084 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 254/505] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:23 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:24.275645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:24.276962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:24.284583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.285268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.286124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:24.286641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:24.432223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:24.440897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:24.442429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:24.443608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5e824c30-2e40-4178-bc14-f5d0b4992f06 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.172329 Jun 20 06:15:24.444663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 252/506] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:24 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:25.475137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:25.482220 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:25.494466 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.495025 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.495901 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:25.496402 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:25.717242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:25.725724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:25.727357 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:25.728558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-360e192f-a9b3-4b9b-a9ca-cef95c1d8b73 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.269830 Jun 20 06:15:25.729166 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 255/507] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:25 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:26.748641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:26.749568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:26.759680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.760288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.761386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.761976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.772508 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:26.773903 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:26.783929 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.786798 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.789286 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:26.790300 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:26.830792 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-80feb101-bf5a-4edc-afef-83921d97525e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/ips" status: 200 len: 150 microversion: 2.1 time: 0.062880 Jun 20 06:15:26.833968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 256/508] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:15:26 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/ips => generated 150 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:26.912855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:26.924165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:26.926253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:26.927441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b6095448-d831-42be-ae32-b01bea5670e0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.183475 Jun 20 06:15:26.940140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 253/509] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:26 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:27.947562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:27.948463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:27.954968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.955509 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:27.956968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:27.957528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:28.365028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:28.373673 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:28.375389 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:28.376571 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9ad97a13-6c07-4aec-92eb-f3e7351d77d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.433004 Jun 20 06:15:28.377236 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 257/510] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:27 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:29.395981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:29.397374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:29.405283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.405735 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.406533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:29.406965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:29.579200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:29.590819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:29.592374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:29.594314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-53c3be54-e8dc-4032-8757-4e95134d6caf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.203156 Jun 20 06:15:29.606178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 254/511] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:29 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:30.352968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055c4560-044b-4a5c-9f94-e875f159af44"}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:30.354815 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:30.361707 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.365511 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.366594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.367285 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.615418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:30.616213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:30.637324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.638192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.639334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:30.639864 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:30.729115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-07dc4142-6a0f-440d-9140-278b3eaeac85 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.379323 Jun 20 06:15:30.735376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 258/512] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:30 2022] POST /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments => generated 194 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:30.887921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:30.897934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:30.899893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:30.901169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e8534144-1f15-4142-9f21-1c9620add5ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.291633 Jun 20 06:15:30.912934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 255/513] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:30 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:31.366467 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:31.367131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:31.377631 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.378707 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.379604 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.380134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.415862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e7b29882-dcbf-44ce-a4b6-9a51848f5ea1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/ips" status: 200 len: 146 microversion: 2.1 time: 0.055493 Jun 20 06:15:31.416475 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 259/514] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:15:31 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/ips => generated 146 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:31.919957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:31.920580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:31.932499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.932660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:31.933412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:31.934037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:32.085329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:32.094701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:32.096224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:32.098042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7e8972b7-c092-4b3b-81e0-a669c8819047 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.181960 Jun 20 06:15:32.098612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 256/515] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:31 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:33.117127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:33.117753 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:33.124034 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:33.124492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:33.125285 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:33.125724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:33.255500 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:33.263454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:33.265018 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:33.266173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-44220f7a-2769-4c87-ae6b-a6e341299261 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.153461 Jun 20 06:15:33.266724 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 260/516] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:33 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:34.289214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:34.290784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:34.298973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:34.299511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:34.300714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:34.302201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:34.430945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:34.439094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:34.440605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:34.442607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5232df2e-3031-4d4a-a3e4-b0ceea2f63f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.162376 Jun 20 06:15:34.442607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 257/517] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:34 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:35.460021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:35.460646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:35.467234 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.467690 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.468456 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.468929 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.600239 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:35.608912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:35.610439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:35.611606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9f06fcc7-113e-4409-aacc-91b50be76d9d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.155747 Jun 20 06:15:35.612160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 261/518] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:35 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:35.655810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3a345f1f-f0aa-4e0c-8cc3-12b4dda8484b"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:35.656971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:35.664578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.665077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.665819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:35.666250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:35.953476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ba0a4779-610c-49f2-9c88-bf67fab4bc2f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303355 Jun 20 06:15:35.954113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 258/519] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:35 2022] POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:36.080149 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "37a89e32-60f5-4170-8e02-34418dfa7252", "device": "/dev/sdb"}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:36.081809 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:36.088271 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.088827 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.089685 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.090130 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.342407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1676302564", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1814282609", "security_groups": [{"name": "tempest-secgroup-smoke-1167724178"}], "block_device_mapping_v2": [{"uuid": "b3a97b01-4448-4b67-981c-4886c6a4cfe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a963e-b480-49e6-9783-3876a7922a09"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:36.368512 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8de88ef4-0873-4347-8978-97c603530c1b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "POST /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293288 Jun 20 06:15:36.369242 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 262/520] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:15:36 2022] POST /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:36.493977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] validate_networks() for [('f55a963e-b480-49e6-9783-3876a7922a09', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:36.633281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:36.633653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:36.640318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.641028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.641947 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:36.642692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:36.977143 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:36.985452 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:36.986980 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:36.988151 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-57647854-a804-4674-baaf-020196bac839 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.361205 Jun 20 06:15:36.989574 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 263/521] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:36 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:37.227453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:37.227938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:37.228250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:37.228741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:37.229140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:37.241057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.241517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.242328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:37.242772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:37.260744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:37.264873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for user b19967e2b09342e9ac006151002bf71a and project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:37.323989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:37.326374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3a97b01-4448-4b67-981c-4886c6a4cfe8',volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:37.471818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9f440429-31cd-41b3-9d07-6d473f65d470 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.133992 Jun 20 06:15:37.472461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 259/522] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:15:37.484270 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-52a4c462-bbf9-4110-8c7c-0df8832f83e6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:37.486388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-52a4c462-bbf9-4110-8c7c-0df8832f83e6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:37.561088 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-52a4c462-bbf9-4110-8c7c-0df8832f83e6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:37.569177 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-52a4c462-bbf9-4110-8c7c-0df8832f83e6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1095 microversion: 2.1 time: 0.089602 Jun 20 06:15:37.569863 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 264/523] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:37 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1095 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:38.007258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:38.007871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:38.014292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.014760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.015517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.016126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.173099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.182470 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.183940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.185278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f868cf2c-9909-4486-bc04-b2202af09a7f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.181979 Jun 20 06:15:38.185868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 260/524] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:38 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:38.587541 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:38.588276 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:38.595449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.596040 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.596912 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:38.597425 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:38.617076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:38.662118 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:38.669602 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ab0a5521-8848-49d8-9dd6-8ce9afb60e72 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1193 microversion: 2.1 time: 0.085933 Jun 20 06:15:38.670171 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 265/525] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:38 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1193 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:39.205176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:39.205817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:39.212402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.212893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.213665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.214099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.392868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:39.401286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:39.402984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:39.404221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8f23f62b-7a92-47e3-bdf4-b1570e543f18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.202921 Jun 20 06:15:39.405088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 261/526] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:39 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:39.440345 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-fde74da1-842c-4f7c-83d1-3d035385877c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: .version_select at 0x7f21ed932e50>, body: {"keypair": {"name": "tempest-keypair-211024648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPW3/rA9nsMEyYLk/KAbp5C2DAuiOGtbwl7x7ZI8zezA7ejwjnsu+JIcM07qAwjPjhhq1EE8NFk6aQ2FA+6fHYUKvV3KVpRX1CeWO/W0X6ENY7qJip6Q9P2RklfAStkHA=="}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:39.454991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-fde74da1-842c-4f7c-83d1-3d035385877c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:39.459944 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.quota [None req-fde74da1-842c-4f7c-83d1-3d035385877c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117586) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:39.482845 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-fde74da1-842c-4f7c-83d1-3d035385877c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046333 Jun 20 06:15:39.483706 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 266/527] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:15:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:39.687548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:39.688391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:39.701404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.702279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.703277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.703887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.913832 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-ddda4f9c-3ca0-46eb-a451-3c8be13e785b req-d9c7e601-d9f6-4db4-85ea-1bb0f715379a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "name": "network-vif-plugged", "status": "completed", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:39.945274 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-ddda4f9c-3ca0-46eb-a451-3c8be13e785b req-d9c7e601-d9f6-4db4-85ea-1bb0f715379a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:39.948931 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-ddda4f9c-3ca0-46eb-a451-3c8be13e785b req-d9c7e601-d9f6-4db4-85ea-1bb0f715379a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:39.976117 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-ddda4f9c-3ca0-46eb-a451-3c8be13e785b req-d9c7e601-d9f6-4db4-85ea-1bb0f715379a service nova] Creating event network-vif-plugged:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:15:39.982797 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-ddda4f9c-3ca0-46eb-a451-3c8be13e785b req-d9c7e601-d9f6-4db4-85ea-1bb0f715379a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076047 Jun 20 06:15:39.984216 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 267/528] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:40.001552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.014772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0e614429-a3a7-4a37-afb3-def4919d5136 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.330998 Jun 20 06:15:40.016258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 262/529] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:39 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:40.424272 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:40.425219 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:40.434531 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.435915 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.436957 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.437507 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.655305 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.670267 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.672988 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:40.675183 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-28bf8453-5215-494b-b917-c741d7f40962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.255567 Jun 20 06:15:40.677297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 268/530] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:40 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:40.786580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-b0e4f50e-bb5a-4435-9139-77237e7e8694 req-3cd26820-5b05-4f84-b34f-8be95fbbf9d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6135799a-c691-4c98-af12-4cce0ab2da1a", "tag": "dd7d7a75-898c-4bff-8619-68169fbb9797"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:40.790694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:40.810036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b0e4f50e-bb5a-4435-9139-77237e7e8694 req-3cd26820-5b05-4f84-b34f-8be95fbbf9d0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:40.810837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b0e4f50e-bb5a-4435-9139-77237e7e8694 req-3cd26820-5b05-4f84-b34f-8be95fbbf9d0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:40.824982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:40.828572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-b0e4f50e-bb5a-4435-9139-77237e7e8694 req-3cd26820-5b05-4f84-b34f-8be95fbbf9d0 service nova] Creating event network-changed:dd7d7a75-898c-4bff-8619-68169fbb9797 for instance 6135799a-c691-4c98-af12-4cce0ab2da1a on hv-cinder-80403 Jun 20 06:15:40.836002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-b0e4f50e-bb5a-4435-9139-77237e7e8694 req-3cd26820-5b05-4f84-b34f-8be95fbbf9d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054085 Jun 20 06:15:40.839626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 263/531] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:41.036640 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:41.037375 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:41.048271 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:41.048680 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:41.049491 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:41.053361 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:41.276970 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:41.297206 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d0833879-6849-408e-9cc9-246bf77c2c77 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.265341 Jun 20 06:15:41.297806 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 269/532] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:41 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:41.337114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1176324810", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e482afaf-8e11-49aa-a25e-27526ac7158f"}], "security_groups": [{"name": "tempest-securitygroup--1103893336"}], "key_name": "tempest-keypair-211024648", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:41.458574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] validate_networks() for [('e482afaf-8e11-49aa-a25e-27526ac7158f', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:41.695593 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:41.696244 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:41.703842 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:41.704778 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:41.706055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:41.706501 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.042261 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.053213 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.055101 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.056356 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b67fcd4d-86da-48c2-9ff5-a97de7c98f19 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.365718 Jun 20 06:15:42.057016 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 270/533] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:41 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:42.212833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:42.213296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:42.213721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:42.214306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:42.214808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:42.223685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.224066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.224915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.225355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.245367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:42.249511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:42.261845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:42.264215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:42.314312 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:42.315147 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:42.322131 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.322587 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.323359 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:42.323800 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:42.338122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-63cad06f-6b9e-4505-a9da-75239f82a00e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.006491 Jun 20 06:15:42.344191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 264/534] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 1013 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 20 06:15:42.349993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9bf87f51-925c-4138-b89e-8239e1a73eee tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:42.350811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9bf87f51-925c-4138-b89e-8239e1a73eee tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:42.431219 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9bf87f51-925c-4138-b89e-8239e1a73eee tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.438856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9bf87f51-925c-4138-b89e-8239e1a73eee tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1241 microversion: 2.1 time: 0.093276 Jun 20 06:15:42.448567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 265/535] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:42 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:42.552104 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:42.560257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8db7c644-4c11-4434-97e1-c5aa707f8120 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.250285 Jun 20 06:15:42.560837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 271/536] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:42 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:43.078242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:43.078860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:43.090944 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.091654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.094270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.094876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.241769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.250401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.252107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.253313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-71c0a0cc-37bb-4f30-a19c-f9a42b931594 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.180339 Jun 20 06:15:43.255036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 266/537] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:43 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:43.455245 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:43.455915 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:43.462759 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.463620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.465503 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.466194 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.546649 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.554682 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-547400d6-c6af-4092-9b90-5e07fb3fae07 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1301 microversion: 2.1 time: 0.103198 Jun 20 06:15:43.555257 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 272/538] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:43 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1301 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:43.576932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:43.577655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:43.584663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.585238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.586092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:43.586742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:43.960874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:43.968233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-45764abb-9a92-4e00-961c-879412bc88da tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.395402 Jun 20 06:15:43.968903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 267/539] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:43 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:44.272819 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:44.273439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:44.276458 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:44.280448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.281246 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.282514 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.282968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.331087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-470890497", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:44.385531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] validate_networks() for None {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:15:44.627234 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:44.635598 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:44.637137 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:44.638295 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e33f9dbd-b196-4bef-a722-b09fb5f91aa5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.369970 Jun 20 06:15:44.648914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 273/540] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:44 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:44.648914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:44.648914 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:44.650390 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.651062 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.651829 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.652269 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.728865 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:44.736792 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4154a4fc-64d7-413e-81fa-5098c365d311 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1299 microversion: 2.1 time: 0.096957 Jun 20 06:15:44.737553 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 274/541] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:44 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:44.835982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:15:44.836644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:15:44.837159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:15:44.837581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:15:44.837994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:15:44.850451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.851044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.851965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.852504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.871894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Getting quotas for project eacc7c8afabe4ac4a9d585ed6f2ae4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:15:44.876109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Getting quotas for user 619ee1d4e1274269823ef8500d264852 and project eacc7c8afabe4ac4a9d585ed6f2ae4ef. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:15:44.887611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:15:44.890048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:15:44.937333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-97bb4f80-fea9-4c97-ad0b-38e6f8bbb60a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610176 Jun 20 06:15:44.938476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 268/542] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:15:44.949110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-91c372d3-e902-424d-8daf-af5a135084b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:44.949727 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-91c372d3-e902-424d-8daf-af5a135084b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:44.985658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:44.986307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:44.994432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.994895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:44.995681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:44.996189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.012933 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-91c372d3-e902-424d-8daf-af5a135084b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:45.020917 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-91c372d3-e902-424d-8daf-af5a135084b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1214 microversion: 2.1 time: 0.075674 Jun 20 06:15:45.021695 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 275/543] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:44 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:45.220091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:45.230014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d3c4ce92-1124-432a-837d-7d983634bbe6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.248579 Jun 20 06:15:45.230603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 269/544] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:44 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:45.658481 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:45.659109 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:45.666797 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.667367 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.668502 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.669098 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.758191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:45.758191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:45.767083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.767638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.769881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:45.771260 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:45.981451 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:45.998098 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.000064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.001771 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-96b3e8e5-43b8-45d8-8595-46efa762afdb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1743 microversion: 2.20 time: 0.347246 Jun 20 06:15:46.003100 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 276/545] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:45 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1743 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:46.011129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-ed64c8f8-4ee0-467f-b33c-dec6ac689f59 req-19ee1948-8b17-49e7-945e-824c07d4683c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d58d309-e139-4ba1-bfbb-3eb6374de542", "tag": "67e94a03-949a-423c-a8aa-c27c606120ac"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:46.025646 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-ed64c8f8-4ee0-467f-b33c-dec6ac689f59 req-19ee1948-8b17-49e7-945e-824c07d4683c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.026402 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-ed64c8f8-4ee0-467f-b33c-dec6ac689f59 req-19ee1948-8b17-49e7-945e-824c07d4683c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.043499 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-ed64c8f8-4ee0-467f-b33c-dec6ac689f59 req-19ee1948-8b17-49e7-945e-824c07d4683c service nova] Creating event network-changed:67e94a03-949a-423c-a8aa-c27c606120ac for instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 on hv-cinder-80403 Jun 20 06:15:46.050365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-ed64c8f8-4ee0-467f-b33c-dec6ac689f59 req-19ee1948-8b17-49e7-945e-824c07d4683c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044918 Jun 20 06:15:46.052024 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 277/546] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:15:46.058260 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:46.059202 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:46.086033 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.089389 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.092233 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.093106 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.243808 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.247022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.256589 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-805c41e8-e4fe-42d9-ae96-7ab4374f70b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1210 microversion: 2.1 time: 0.203092 Jun 20 06:15:46.258931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d451c71b-8fd3-4aea-86ff-008755d5f32c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.505780 Jun 20 06:15:46.261364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 270/547] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:45 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:46.274019 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 278/548] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:46 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1210 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:46.278655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:46.280867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:46.289017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.289476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.290307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.290923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.467013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:46.475422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fe34176a-658f-4fa2-b91e-be0b8ba7c264 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.212722 Jun 20 06:15:46.476007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 271/549] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:46 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:46.767021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e47148ad-9b0f-435c-a40d-a57bfda5f074 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:46.783134 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e47148ad-9b0f-435c-a40d-a57bfda5f074 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.784078 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e47148ad-9b0f-435c-a40d-a57bfda5f074 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.854445 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e47148ad-9b0f-435c-a40d-a57bfda5f074 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Going to try to stop instance {{(pid=117586) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:15:46.911794 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e47148ad-9b0f-435c-a40d-a57bfda5f074 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.148367 Jun 20 06:15:46.912434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 279/550] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:15:46 2022] POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:15:46.921876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:46.929104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:46.942560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.943148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:46.944052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:46.946080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.022250 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:47.023254 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:47.029861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.030414 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.031576 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.032218 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.292822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.306062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cca4e030-b3f3-4eeb-8ec2-85aa2a425391 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.387823 Jun 20 06:15:47.306569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 272/551] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:46 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:47.314507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:47.315306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:47.328466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.328948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.329849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.331095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.432529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.441166 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.442719 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.443897 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-74ce9088-3bae-4fac-9036-9ddae2547cd0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.426683 Jun 20 06:15:47.454848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 280/552] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:47 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:47.455429 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:47.456049 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:47.476492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.476983 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.477774 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.478220 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.584547 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.590704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.592374 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-778998e6-ea7b-42ee-8d5c-37731ffada11 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1272 microversion: 2.1 time: 0.142744 Jun 20 06:15:47.592987 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 281/553] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:47 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:47.608586 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:47.609200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f344a28b-0d6c-4ed8-9892-7b6b2b029bd9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.296551 Jun 20 06:15:47.609318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:47.610114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 273/554] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:47 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:47.617581 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.618041 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.618870 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:47.619317 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:47.854788 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:47.868492 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b3aab394-ead2-4a30-a4f3-fbf3dce77e9e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.262171 Jun 20 06:15:47.869577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 282/555] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:47 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:48.325537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.326746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.335311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.336067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.336787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.337230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.470305 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.471268 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.492059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.492784 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.493664 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.494310 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.541459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.557469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0c1fe738-c7f1-46c1-a052-dc4906d33fc2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.232592 Jun 20 06:15:48.560236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 274/556] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:48 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:48.609115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.610466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.624950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.625694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.626668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.627559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.720132 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.731448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.734447 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.736015 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2432d60f-8570-4d8c-b21d-12dd786d4987 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.274157 Jun 20 06:15:48.736768 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 283/557] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:48 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:48.747300 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.749037 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.766653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.767258 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.768181 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.768634 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.797429 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:48.886613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:48.897964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e89bfb2b-0139-4172-916a-9b72b272640c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.292792 Jun 20 06:15:48.899249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 275/558] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:48 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:48.906468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:48.907385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:48.915476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.916224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:48.917251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:48.917901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.043376 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.054943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7636c6f6-e9c0-41f8-859d-d9b1cce8433a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.316884 Jun 20 06:15:49.065392 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 284/559] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:48 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:49.368537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.380332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-63cfb893-9557-40f9-a1c1-53a737dd3468 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.479787 Jun 20 06:15:49.381241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 276/560] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:48 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:49.582127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:49.582773 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:49.588883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.589334 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.590096 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.590532 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.757590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:49.758724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:49.764538 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.769332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.770010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.771312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.772001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.788687 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ccca6103-ad2b-4f5a-bb3b-dc78af1cc9ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.210431 Jun 20 06:15:49.789483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 285/561] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:49 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:49.918867 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:49.919932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:49.928185 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.929758 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.931083 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:49.931569 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:49.939482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.948594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.950637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:49.952216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8ad29d24-2115-4b0a-a846-883a2ee8b088 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.201123 Jun 20 06:15:49.952975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 277/562] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:49 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:50.071481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.072538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.080518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.081000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.082042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.083192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.099573 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:50.109309 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-addfa45f-e369-4eea-a085-769f82c507d1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.194956 Jun 20 06:15:50.120166 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 286/563] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:49 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:50.227619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:50.235987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9912cc8b-1e14-4ad5-b0f1-4752c972c2f7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.168401 Jun 20 06:15:50.236549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 278/564] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:50.397708 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.398699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.405063 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.405603 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.406572 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.407107 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.557455 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:50.564921 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9fd044ed-29c8-44fb-80c4-732098b01f45 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.171787 Jun 20 06:15:50.566297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 287/565] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:50.807332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.809259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.820670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.821894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.822872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.823481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.971091 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:50.971621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:50.978876 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.979660 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:50.980653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:50.981279 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.209005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.217385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-463fd40e-0fe9-438e-8d3c-c8b014e6a37f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.416292 Jun 20 06:15:51.234579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 279/566] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.236442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.237213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.245809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.246264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.248949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.249640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.431999 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.440490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.446315 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.447501 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a4adcca0-9d9b-4656-9f1a-1c2a9768f4d1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.480639 Jun 20 06:15:51.448066 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 288/567] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:50 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:51.460493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.461154 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.473918 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.474394 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.475181 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.475629 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.704121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.712443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0400bae0-86ed-43a0-8649-2950604ee49d tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.485204 Jun 20 06:15:51.722210 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 280/568] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:51.727301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:51.727924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:51.734581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.735181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.735872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:51.736354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:51.852750 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:51.863472 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-f0720c6d-27e5-435e-b37b-80d457cad3e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.412417 Jun 20 06:15:51.864441 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 289/569] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:52.102962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.121333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-88ebca11-2059-4d70-9ebf-eaa973bf62c0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.397695 Jun 20 06:15:52.121917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 281/570] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:51 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:52.243052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.243667 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.250388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.251299 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.252466 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.253078 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.469522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.470454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.478466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.479279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.480329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.481009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.517628 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.539332 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6840a0cc-ae04-4a57-937c-64f1cfb07bfa tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.300361 Jun 20 06:15:52.540208 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 290/571] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:52.602368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-355b7ba7-551b-47d9-ae77-a1422102ea5f req-1a9ef1e3-ad68-4020-b6bb-8d9f29daa2dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71a4ef5a-d635-44a6-8c7c-b0d764df5248", "tag": "642c9ae2-7169-4fbc-b937-5728499c1e67"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:52.615866 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-355b7ba7-551b-47d9-ae77-a1422102ea5f req-1a9ef1e3-ad68-4020-b6bb-8d9f29daa2dc service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.616653 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-355b7ba7-551b-47d9-ae77-a1422102ea5f req-1a9ef1e3-ad68-4020-b6bb-8d9f29daa2dc service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.631962 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-355b7ba7-551b-47d9-ae77-a1422102ea5f req-1a9ef1e3-ad68-4020-b6bb-8d9f29daa2dc service nova] Creating event network-changed:642c9ae2-7169-4fbc-b937-5728499c1e67 for instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 on hv-cinder-80403 Jun 20 06:15:52.640340 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-355b7ba7-551b-47d9-ae77-a1422102ea5f req-1a9ef1e3-ad68-4020-b6bb-8d9f29daa2dc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041579 Jun 20 06:15:52.641694 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 291/572] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:52.691859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.697979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:52.704513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.706059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.707507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5299c947-2576-4480-a5f9-41b05066f343 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.242677 Jun 20 06:15:52.719868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 282/573] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:52.732337 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.734474 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.745629 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.746123 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.747120 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.747631 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.880141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:52.882256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:52.892128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.898432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.908673 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:52.909503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:52.936745 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:52.945697 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-636bcb4f-643b-497d-8aa4-dfd86196a8ef tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.219463 Jun 20 06:15:52.946053 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 292/574] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:53.076890 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:53.085609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b7ed48c6-8654-4881-adcc-dc9b0f84e8d0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.210120 Jun 20 06:15:53.086477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 283/575] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:52 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:53.139119 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:53.140168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.146420 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.146885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.147672 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.148384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.285491 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:53.293545 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-99267871-3d3d-432d-89fc-7886b39499d8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.158324 Jun 20 06:15:53.294331 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 293/576] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:53 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:53.563941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:53.564855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.572233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.574156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.574156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.574156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.725848 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:53.726561 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.733930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.735380 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.736504 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:53.737032 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:53.942659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:53.970950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bcade408-8fcc-4b04-9bb2-63a66387fa2e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.394659 Jun 20 06:15:53.972660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 284/577] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:53 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:53.978706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:53.979632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:53.999914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.000548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.001481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.004975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.048296 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.056606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.059661 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.061075 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-da00c9f0-82f8-4689-9cce-34fd45f3478c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.339318 Jun 20 06:15:54.072828 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 294/578] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:53 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:54.102977 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:54.103589 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:54.112991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.113555 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.114197 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.114639 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.350601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.371839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4746a8b2-2a83-4d9c-a9e8-19e2c77ee3b6 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.394977 Jun 20 06:15:54.373388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 285/579] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:53 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:54.385793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:54.390322 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.392657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:54.401231 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-9797d9ff-88ff-4b6c-b865-58eaa0c404cf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.299680 Jun 20 06:15:54.403997 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 295/580] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:54 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:54.406555 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.407895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.409268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.410565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.660208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:54.666378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-f0820d75-6e5d-4c11-a009-719d6a084530 req-0778e270-a175-4e5c-8341-7aa498056c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d58d309-e139-4ba1-bfbb-3eb6374de542", "name": "network-vif-plugged", "status": "completed", "tag": "67e94a03-949a-423c-a8aa-c27c606120ac"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:15:54.671378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-af5f54f1-b60c-465b-a063-0fdeb0742607 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.295730 Jun 20 06:15:54.672209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 286/581] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:54 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:54.678485 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-f0820d75-6e5d-4c11-a009-719d6a084530 req-0778e270-a175-4e5c-8341-7aa498056c1f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:54.680129 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-f0820d75-6e5d-4c11-a009-719d6a084530 req-0778e270-a175-4e5c-8341-7aa498056c1f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:54.698590 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-f0820d75-6e5d-4c11-a009-719d6a084530 req-0778e270-a175-4e5c-8341-7aa498056c1f service nova] Creating event network-vif-plugged:67e94a03-949a-423c-a8aa-c27c606120ac for instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 on hv-cinder-80403 Jun 20 06:15:54.703698 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-f0820d75-6e5d-4c11-a009-719d6a084530 req-0778e270-a175-4e5c-8341-7aa498056c1f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040895 Jun 20 06:15:54.704905 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 296/582] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:15:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:15:54.989648 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:54.990261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:54.992125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:54.993389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=20 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:55.001162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.001623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.002410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.002857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.082393 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.086425 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.088733 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell0:SELECT=8 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:55.099969 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.100731 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.101863 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.102497 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.150229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.159630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-06348a2c-d8c0-4a2a-9d56-1a5232fe8b6f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.173970 Jun 20 06:15:55.161481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 287/583] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:54 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:55.265445 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.275951 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.278032 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.279371 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-aaff643e-5378-4ea6-805a-c1d950439482 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.203008 Jun 20 06:15:55.280418 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 297/584] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:55.390980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.391728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.405343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.405858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.410388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.411033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.424159 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.425218 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.431861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.432562 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.433523 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.434139 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.652691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.660285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f647bb38-950e-4e3f-acc9-181fccaa3314 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.273461 Jun 20 06:15:55.663767 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.679578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 288/585] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:55.681872 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-7a26e6b2-bf45-4c15-9380-1c8a5db15de8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.266363 Jun 20 06:15:55.682466 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 298/586] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:55.692358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:55.692358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:55.698243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.698699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.699478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:55.699914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:55.864679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:55.873818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dd181755-0bf9-4f28-974f-91cace3555fe tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.188002 Jun 20 06:15:55.874419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 289/587] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:55 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:56.178885 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.179774 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.187614 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.188188 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.189081 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.189763 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.298418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.299435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.311205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.312724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.314417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.315105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.347079 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.357555 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-91cb5467-aa9d-4a84-b6c3-1fad4d186dc0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.183188 Jun 20 06:15:56.369133 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 299/588] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:56.484176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.494901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.496516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.497792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-24beea26-895d-403c-906f-f8ba435c93dd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.204159 Jun 20 06:15:56.502731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 290/589] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:15:56.684215 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.684787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.691533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.691993 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.692830 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.693287 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.700188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.701002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.708486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.709112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.710019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.710589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.917753 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.926583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1828ab9c-cf3c-47f6-b061-c359867d0c5a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.246371 Jun 20 06:15:56.927547 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 300/590] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:56.933291 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:56.934563 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:56.947729 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.948295 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.949271 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:56.950236 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:56.956785 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:56.965112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-84215aad-4225-4e1a-bafd-dcebf71a3932 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.269135 Jun 20 06:15:56.979292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 291/591] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.151353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.160161 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1c45e17b-ec0c-4be4-9b61-243d32abd0e7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.231439 Jun 20 06:15:57.160856 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 301/592] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:56 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.375402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.376018 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.383978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.384749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.385883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.386542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.520180 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.521423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.524294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.532907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.533131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9b2e2a81-a69c-41eb-98bb-d5ec1665ef86 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.161283 Jun 20 06:15:57.533364 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.534142 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.534734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.543184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 292/593] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:57.558544 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:57.691612 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.700309 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.701851 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:57.703009 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-86737b46-4b8a-4bf3-ace4-43c28da74c9b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.188497 Jun 20 06:15:57.703570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 302/594] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:57.944174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.944739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.950817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.951278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.952049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.952497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.987787 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:57.988388 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:57.994473 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.994928 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:57.995701 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:57.996147 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.131623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.139036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2381cc9f-61c9-464a-a8c1-0f0fb2657356 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.199590 Jun 20 06:15:58.139617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 293/595] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:58.160196 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.167594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4813625f-d826-4f49-864e-7d05766714c4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.184505 Jun 20 06:15:58.168157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 303/596] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:57 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:58.178815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:58.179449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:58.185467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.185916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.186669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.187104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.317182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.324537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-20f550fa-36c4-4650-bb1a-d456c13ef62d tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.150265 Jun 20 06:15:58.325132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 294/597] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:58 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:58.550020 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:58.550561 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:58.557143 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.557600 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.558366 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.558814 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.683692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.692222 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-35bb9945-0973-428e-818a-453d46c9b900 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.146289 Jun 20 06:15:58.692833 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 304/598] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:58 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:58.719787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:58.720393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:58.727034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.727485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.728244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:58.728681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:58.859663 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.868167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.869707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:58.870857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d78d2ddb-8f6c-4efc-a699-abe79b83ef7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.154931 Jun 20 06:15:58.871410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 295/599] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:58 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:15:59.156004 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.156541 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.163570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.164060 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.164866 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.165323 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.185081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.185802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.192533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.193016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.193787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.194226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.353462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:59.361174 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b0914339-f68a-4400-a24e-bc7269c6558a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.209068 Jun 20 06:15:59.361738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 305/600] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:59.366379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.366986 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.372970 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.373424 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.374139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:59.374259 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.374606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.381853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-695fd106-7283-49cf-97eb-39437b1ef259 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.200570 Jun 20 06:15:59.382433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 296/601] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:15:59.506520 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:59.516173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-947e086a-db3d-442d-85a6-76efb7df2a79 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.153466 Jun 20 06:15:59.516784 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 306/602] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:59.709999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.710538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.712431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:15:59.719434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.720137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.721109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.721700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.862201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:15:59.870134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa39eefc-a394-4fea-ae8b-24a749a5855d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.165200 Jun 20 06:15:59.870697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 297/603] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:15:59.889540 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:15:59.890158 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:15:59.897742 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.898199 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:15:59.898968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:15:59.899408 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.029410 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.037377 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.038907 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.040072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a31ea2e2-187d-45db-a708-ebde7686eace tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.154455 Jun 20 06:16:00.040636 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 307/604] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:15:59 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:00.378038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.378575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.384623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.385105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.385862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.386298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.399389 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.400002 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.405949 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.406401 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.407157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.407598 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.584216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.587678 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.591779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2c050116-93e0-4422-81e8-312a162c473e tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.217605 Jun 20 06:16:00.592356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 298/605] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:00.595157 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bd0ccae8-f65c-4a37-8daa-d21df528f2bd tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.199589 Jun 20 06:16:00.595710 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 308/606] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:00.598051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.598690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.604753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.605273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.606084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.606526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.622370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:00.741553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:00.749555 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b94c34e6-5737-4056-902b-10d4dd268b88 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.156178 Jun 20 06:16:00.750410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 299/607] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:00.888758 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:00.889326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:00.896160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.896770 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:00.897408 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:00.897855 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.026485 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:01.034883 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-12b7c524-9aed-4ec0-83bf-30d5a0284271 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.150789 Jun 20 06:16:01.035449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 309/608] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:00 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:01.058412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:01.059052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:01.065093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.065646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.066411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.066857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.200466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:01.208682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:01.210238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:01.211409 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-93a355e7-e2cc-4719-bf1c-de68158cfc59 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.156889 Jun 20 06:16:01.211972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 300/609] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:01 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:01.610136 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:01.610744 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:01.611394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:01.612051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:01.617780 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.618147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.618281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.618611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.618986 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.619387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:01.619483 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:01.619837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.051594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.058047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.059052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a292bcf2-115e-4160-9a81-7387f562f222 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.453041 Jun 20 06:16:02.059631 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 310/610] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:01 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:02.064008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:02.064615 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:02.065903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b1e67f1-5193-4c9a-b7c5-cf442859a55e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.458532 Jun 20 06:16:02.068901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 301/611] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:01 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:02.070861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:02.071122 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.071471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:02.071591 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.072413 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.072899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.077357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.077821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.078595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.079035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.263209 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.270288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.271357 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0ee87d0f-f92f-49f5-8f87-3d23f5d44556 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.210749 Jun 20 06:16:02.280289 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 311/612] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:02 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:02.280289 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:02.280289 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:02.280646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aae9d996-0555-4d39-96f7-777ab8a7e6f0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.211206 Jun 20 06:16:02.280646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 302/613] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:02 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:02.283228 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.283685 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.285051 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:02.285499 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:02.413284 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.421169 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.422699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:02.423892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2d014f53-57c8-4256-aabc-b53e28294449 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.150826 Jun 20 06:16:02.424454 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 312/614] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:02 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:03.075543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.076156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.082326 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.082947 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.083126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.083591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.084450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.084930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.091221 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.091669 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.092449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.092930 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.282259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.290165 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.290688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8fb1c62a-5482-4a66-a331-0e83c9a2e6b0 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.218702 Jun 20 06:16:03.291548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 303/615] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:03.295875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.296487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.303503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.304318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.304685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.305164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.307248 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-84fcaacb-ad5e-4e27-b381-428ce440b199 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.228665 Jun 20 06:16:03.310535 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 313/616] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:03.320464 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.321148 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.327164 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.327628 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.328396 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.328899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.513065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.519583 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.521093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ad238e22-1f7e-4f96-ae0c-82924ab88f4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.228648 Jun 20 06:16:03.521753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 304/617] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:03.526356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:03.527037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:03.527817 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d364df4c-2a8a-47b2-99de-1d2958324a5f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.216394 Jun 20 06:16:03.528570 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 314/618] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:03.533016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.533471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.534833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:03.535276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:03.663053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.670872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.672378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:03.673633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0cdf7470-d615-4528-9bfc-5ceedbf88152 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.150893 Jun 20 06:16:03.674191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 305/619] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:03 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:04.307941 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.308568 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.315224 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.315721 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.316493 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.316968 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.324228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.324877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.331193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.331655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.332430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.332911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.467630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.476067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ab6b689d-36a4-481c-af21-883a1866c27f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.155886 Jun 20 06:16:04.476646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 306/620] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:04.537982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.538599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.545810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.546273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.547053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.547491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.660356 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.667924 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bcbf3fa5-ddd8-4605-9f8f-69eead911940 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.363880 Jun 20 06:16:04.668577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 315/621] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:04.672979 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.673577 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.680015 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.680475 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.681273 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.681709 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.705940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.713437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-275f1928-ccbf-496d-ac2d-7aa2a9d3ce9f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.180017 Jun 20 06:16:04.714009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 307/622] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:04.718477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:04.719087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:04.725303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.725763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.726547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:04.726996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:04.860782 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.869434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-e4b95626-0594-43df-8487-aa94a441b127 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.199847 Jun 20 06:16:04.870096 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 316/623] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:04.891296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.899455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.900998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:04.902174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0e1ff169-9e1f-4199-b3cd-bf326db6e4ce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.187224 Jun 20 06:16:04.902956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 308/624] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:04 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:05.493670 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.494314 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.500844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.501297 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.502052 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.502490 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.628638 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:05.636068 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-d2b65148-c5b0-4d55-916d-5c72aebadac7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.146234 Jun 20 06:16:05.636620 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 317/625] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:05.685450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.686067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.692808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.693270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.694048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.694494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.730078 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.730608 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.737775 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.738241 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.739041 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.739533 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.914021 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:05.917278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:05.921982 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-0bce23de-4671-4db6-a66c-e933d3f69b43 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.195728 Jun 20 06:16:05.922645 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 318/626] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:05.925003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-293861be-1225-4878-bbfd-18c859d27ad2 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.243428 Jun 20 06:16:05.925968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 309/627] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:05.930311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.930988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.932378 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:05.933023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:05.936957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.937439 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.938213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.938653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.938937 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.939517 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.940368 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:05.940882 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:05.945769 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:06.131365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.135399 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.139423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.140957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.142112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-41a8096a-a23a-44f2-a4ae-9fd726c8b4db tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.215312 Jun 20 06:16:06.142672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 310/628] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:06.143644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-822682c3-55dd-48c3-8a18-9880fcadc6a5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.219676 Jun 20 06:16:06.144422 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 319/629] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:05 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:06.652784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:06.653396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:06.659283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.659727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:06.660484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.660949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:06.791397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:06.798732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b9519bd1-5370-4a87-bb3b-0d25b35439c1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.149857 Jun 20 06:16:06.799297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 311/630] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:06 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:06.938932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:06.939618 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:06.943068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:06.943685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:06.947008 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.947477 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:06.948269 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.948734 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:06.949492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.949946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:06.950713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:06.951166 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.172395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.174055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.182185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf5f3aa0-abab-4da6-98d5-11340527b463 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.243743 Jun 20 06:16:07.184184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 312/631] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:06 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:07.190495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.191413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.196517 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a6d166c3-39bd-45a8-bd7b-645b4903f22b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1279 microversion: 2.1 time: 0.261779 Jun 20 06:16:07.197318 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 320/632] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:06 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1279 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:07.199106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.199718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.200657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.201574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.206219 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.206219 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.210152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.210606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.211379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.211838 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.405658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.409020 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.414437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.415957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.417146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fd572a50-56bd-43ad-943a-afd3fc252beb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.231492 Jun 20 06:16:07.417558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-30114256-d290-4d0e-8f0b-87abc964356c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.219161 Jun 20 06:16:07.417747 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 313/633] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:07 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:07.418112 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 321/634] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:07 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:07.816546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:07.817190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:07.823704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.824160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.824988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:07.825471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:07.959715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:07.967081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b616fea6-75d2-4183-b864-96414ac02881 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.154428 Jun 20 06:16:07.967576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 314/635] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:07 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:08.201621 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.202253 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:08.205705 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:08.212358 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.212845 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.213624 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.214064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.215553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.216324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:08.222836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.223225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.224013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.224462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.410554 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.418184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-4411510a-7573-490e-aca7-bb91d81582d5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.220389 Jun 20 06:16:08.418637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.418753 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 322/636] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:08 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:08.426849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-84adfa04-de40-477b-9755-546f485118ac tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.215633 Jun 20 06:16:08.427411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 315/637] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:08 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:08.434230 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.434844 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:08.441789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.442304 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.442417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:08.442763 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.443543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.443994 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.448599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.449091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.449897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.450341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.454440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:08.634805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.638529 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.642781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.644524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:08.645728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-69c3438e-3d1e-496c-ac9d-1d7b8199b2d0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.208533 Jun 20 06:16:08.646300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 316/638] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:08 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:08.647168 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-df8f047c-b2d8-4e9f-929d-5d0bb2a1299f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.216877 Jun 20 06:16:08.647899 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 323/639] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:08 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:08.983989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:08.984593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:08.991398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.991848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:08.992602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:08.993062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.119194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.126648 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e5d6a7c0-89ce-4706-b8b3-df189d76577b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.146783 Jun 20 06:16:09.127217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 317/640] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:08 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:09.435409 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:09.436019 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:09.443210 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:09.443398 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.443687 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.444160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:09.444458 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.444926 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.450261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.450716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.451499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.451940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.640534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.648615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d45a5a2a-a960-4eea-afca-98a8d30e6bf8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.209323 Jun 20 06:16:09.649408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 318/641] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:09 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:09.652277 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.660243 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-64b4565d-82cf-45cc-81df-f8fa4595631f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.228723 Jun 20 06:16:09.662043 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 324/642] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:09 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:09.663579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:09.664188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:09.666463 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:09.667072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:09.670376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.670839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.671602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.672040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.672842 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.673305 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.674072 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:09.674549 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:09.868041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.871365 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.876172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-51b0ee67-f52a-4453-bcca-06045adfcff7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.216847 Jun 20 06:16:09.876763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 319/643] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:09 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:09.879557 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.881217 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:09.882382 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1c719975-cc80-43a2-8ead-c18069b9569e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.219430 Jun 20 06:16:09.882936 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 325/644] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:09 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:10.142576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:10.143114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:10.150540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.150988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.151745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.152180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.282271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:10.290071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aef02a43-2824-4df6-b88d-249ef6f69710 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.151359 Jun 20 06:16:10.290629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 320/645] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:10 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:10.665448 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:10.666055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:10.672587 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.673387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.674156 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.674597 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.678876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:10.679500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:10.685490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.685952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.686727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.687174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.871223 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:10.873810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:10.878892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-3585c43e-59d2-4043-bf7e-06f8d3554de6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.217259 Jun 20 06:16:10.879558 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 326/646] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:10 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:10.881670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-da1f8e0a-89b7-4b67-88f7-8e720b2c9d74 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.207376 Jun 20 06:16:10.882226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 321/647] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:10 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:10.892672 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:10.893320 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:10.899153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:10.899462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.899767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:10.899932 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.900732 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.901294 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.905608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.906066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:10.906847 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:10.907270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.097307 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:11.100829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:11.106308 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-98b13e9e-d2ec-450f-8271-effe3c24688a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.217209 Jun 20 06:16:11.106892 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 327/648] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:10 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:11.109222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:11.110736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:11.111883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2afbdf6a-4e34-4f77-a120-cc5e693ae44f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.216532 Jun 20 06:16:11.112429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 322/649] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:10 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:11.307319 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:11.308006 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:11.313977 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.314439 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.315218 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.315667 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.447791 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:11.455441 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-86d4c3c0-33ab-4713-936a-92d2399f1c41 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.151925 Jun 20 06:16:11.456011 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 328/650] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:11 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:11.896167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:11.896872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:11.898190 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:11.898801 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:11.903200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.903655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.904423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.904883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.905214 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.905672 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:11.906427 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:11.906864 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.096112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.100046 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.104511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8545a9a-5151-4134-9eb6-025a11a2bd85 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.213013 Jun 20 06:16:12.105186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 323/651] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:11 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:12.107593 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-eeac6e4a-514e-43d9-a303-866fc1c9a65a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.213899 Jun 20 06:16:12.108423 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 329/652] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:11 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:12.122946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:12.123566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:12.130303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.130760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.130896 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:12.131428 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:12.131528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.131934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.137704 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.138162 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.138936 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.139379 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.322807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.329610 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.330506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0eb0d3fd-a19e-4c8e-9dbf-c41e10ecc828 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.211178 Jun 20 06:16:12.331331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 324/653] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:12 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:12.338281 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.340004 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.341187 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-ae42ac28-5ba3-4cfc-b419-7fa3db6485ee tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.214866 Jun 20 06:16:12.341738 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 330/654] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:12 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:12.473506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:12.473916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:12.479904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.480335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.481117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:12.481553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:12.608425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:12.616516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-98d2ddb5-e8de-4674-8f94-d994feb76aaf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.147655 Jun 20 06:16:12.617113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 325/655] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:12 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:13.122076 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:13.122688 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:13.124831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:13.125451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:13.129227 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.129675 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.130450 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.131285 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.131889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.132346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.133140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.133584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.325786 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.329069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.333403 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-95a185b9-52c5-4934-a8e2-476584986963 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.215165 Jun 20 06:16:13.334650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 331/656] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:13 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:13.337564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6f93d3ec-dec2-4bf9-9989-27bde2c27a84 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.216531 Jun 20 06:16:13.338214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 326/657] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:13 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:13.346943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:13.347551 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:13.354430 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.354886 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.355650 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.356086 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.359722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:13.360342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:13.366503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.367095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.367881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.368333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.564298 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.569505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.575127 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-bdfe47f6-738d-4c4e-823b-f9ff24541259 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1723 microversion: 2.1 time: 0.231719 Jun 20 06:16:13.576759 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 332/658] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:13 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:13.580419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.585183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.585467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b2c70a02-106a-4267-8fbe-470b08750d2c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.229773 Jun 20 06:16:13.586077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 327/659] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:13 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:13.633824 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:13.634607 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:13.640771 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.641229 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.642014 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.642449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.666448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-45380b7e-b73a-4982-bbaa-f0f378eb517a req-b74465ac-63ab-4866-8475-850187a38804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a4ef5a-d635-44a6-8c7c-b0d764df5248", "name": "network-vif-plugged", "status": "completed", "tag": "642c9ae2-7169-4fbc-b937-5728499c1e67"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:13.675499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-45380b7e-b73a-4982-bbaa-f0f378eb517a req-b74465ac-63ab-4866-8475-850187a38804 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:13.676156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-45380b7e-b73a-4982-bbaa-f0f378eb517a req-b74465ac-63ab-4866-8475-850187a38804 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:13.704721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-45380b7e-b73a-4982-bbaa-f0f378eb517a req-b74465ac-63ab-4866-8475-850187a38804 service nova] Creating event network-vif-plugged:642c9ae2-7169-4fbc-b937-5728499c1e67 for instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 on hv-cinder-80403 Jun 20 06:16:13.712423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-45380b7e-b73a-4982-bbaa-f0f378eb517a req-b74465ac-63ab-4866-8475-850187a38804 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050009 Jun 20 06:16:13.714167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 328/660] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:13.804332 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:13.812150 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-6b8af488-876b-4f32-8dd2-c9cafd2affda tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.182858 Jun 20 06:16:13.812739 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 333/661] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:13 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:14.352267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.353039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.355101 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.355730 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.360231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.360690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.361632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.362077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.362628 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.363094 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.363898 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.364344 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.558131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.560910 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.566391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-22ef8334-3add-4356-a14d-605d6395f2f8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.218800 Jun 20 06:16:14.568746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 329/662] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:14.570028 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1d5a7cf9-7a8f-4d6b-9b96-15a21439d6ee tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.219374 Jun 20 06:16:14.570667 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 334/663] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:14.593274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.593883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.599925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.600377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.601344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.601791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.605581 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.606384 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.612594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.613115 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.613913 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.614528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.799273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.808336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c995eb61-ab89-4568-844e-b845cda8e00d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1700 microversion: 2.1 time: 0.218797 Jun 20 06:16:14.808954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 330/664] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1700 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:14.814519 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.818677 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=100 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:14.824730 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.826547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-029185a4-2baa-4670-88b7-5f015c964762 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:14.826713 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:14.827799 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a70c9d6f-0534-4695-8e45-07c6ba2d2782 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1738 microversion: 2.20 time: 0.226171 Jun 20 06:16:14.828606 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 335/665] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:14.833255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-029185a4-2baa-4670-88b7-5f015c964762 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.833485 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.834005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-029185a4-2baa-4670-88b7-5f015c964762 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.834403 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.840594 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.841175 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.841938 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.842543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.910917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-029185a4-2baa-4670-88b7-5f015c964762 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Going to try to start instance {{(pid=117585) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:16:14.956175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-029185a4-2baa-4670-88b7-5f015c964762 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.133711 Jun 20 06:16:14.957104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 331/666] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:16:14 2022] POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:14.966192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:14.966573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:14.972830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.973289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.974086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:14.974541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:14.990631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:15.086933 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.094641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-c29462b8-1c57-4882-9868-525a574e4731 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.264814 Jun 20 06:16:15.095225 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 336/667] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:15.371853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.379763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-97aa5a78-d704-4480-ad92-2656ca643b98 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.418070 Jun 20 06:16:15.380371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 332/668] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:14 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:15.583295 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:15.584489 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:15.587607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:15.587732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:15.590880 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.591340 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.592121 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.592569 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.593844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.594298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.595259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.595878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.798404 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.802296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.806877 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-2d0e699b-40c4-4187-9b5b-f8fc779744af tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.227370 Jun 20 06:16:15.807546 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 337/669] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:15 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:15.810427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2811da59-f3ab-48ad-be8a-0c86d1b67ed5 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.226925 Jun 20 06:16:15.810427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 333/670] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:15 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:15.846160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:15.846725 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:15.854657 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.855114 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.856170 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:15.856983 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:15.988046 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.995996 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.997741 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:15.998999 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-15adcf06-11db-417a-813d-07a5e384c659 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.156755 Jun 20 06:16:15.999603 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 338/671] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:15 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:16.111978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:16.112521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:16.118558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.119016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.119786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.120232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.252988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:16.261012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e418ccc3-6116-48b8-b7f3-b70fa6bf3ed9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.153182 Jun 20 06:16:16.261575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 334/672] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:16 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:16.397185 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:16.397716 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:16.403764 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.404219 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.405010 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.405449 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.532692 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:16.541579 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-1ac239ec-c252-4c79-81da-c25dcf7c4adb tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.148239 Jun 20 06:16:16.542353 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 339/673] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:16 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:16.710939 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:16.711425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:16.718062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.718503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.719483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.719928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.824873 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:16.825658 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:16.834790 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.835443 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.836387 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.836882 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.877340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lazy-loading 'services' on Instance uuid 67e2ba1e-49da-4f92-b169-de4528a1a15f {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:16.974967 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:16.983110 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-97455211-f973-4266-8b5b-1ac0002280ee tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.163141 Jun 20 06:16:16.983751 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 340/674] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:16 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:16.988173 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:16.988837 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:16.995434 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.995628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b267439d-5de3-4a0c-8479-de45e1529e37 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f/os-volume_attachments/37a89e32-60f5-4170-8e02-34418dfa7252" status: 202 len: 0 microversion: 2.1 time: 0.288547 Jun 20 06:16:16.995902 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:16.996221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 335/675] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:16:16 2022] DELETE /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f/os-volume_attachments/37a89e32-60f5-4170-8e02-34418dfa7252 => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:16:16.996745 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:16.997192 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.019634 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:17.020594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:17.044959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.045799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.046832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.047422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.249160 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.257455 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-8826799f-efde-46bc-a8b2-39514a15993c tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.272578 Jun 20 06:16:17.257882 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 341/676] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:16 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:17.259896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.267731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.269262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.270410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b76ab1b2-cfdd-45e2-af35-0537170e1a85 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.255810 Jun 20 06:16:17.271504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 336/677] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:17 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:17.284152 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:17.285327 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:17.292861 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.293312 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.294075 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.294513 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.425144 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.432584 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-05ddc409-6633-4224-9065-222d61ab46af tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.155761 Jun 20 06:16:17.433184 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 342/678] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:17 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:17.559188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:17.559963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:17.566006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.566469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.567247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.568209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.670543 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [req-9c6ef3d9-1851-401e-9761-6e675cc8d7e8 req-2a36070d-6f8a-4441-ba3d-84016bf7a039 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "name": "network-vif-unplugged", "status": "completed", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:17.701955 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-9c6ef3d9-1851-401e-9761-6e675cc8d7e8 req-2a36070d-6f8a-4441-ba3d-84016bf7a039 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:17.702406 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [req-9c6ef3d9-1851-401e-9761-6e675cc8d7e8 req-2a36070d-6f8a-4441-ba3d-84016bf7a039 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:17.703275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:17.713497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5fc7fe4c-0371-4822-a87a-3e421e4e82a8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.158165 Jun 20 06:16:17.716744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 337/679] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:17 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:17.716894 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.compute.server_external_events [req-9c6ef3d9-1851-401e-9761-6e675cc8d7e8 req-2a36070d-6f8a-4441-ba3d-84016bf7a039 service nova] Creating event network-vif-unplugged:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:16:17.722094 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [req-9c6ef3d9-1851-401e-9761-6e675cc8d7e8 req-2a36070d-6f8a-4441-ba3d-84016bf7a039 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.055341 Jun 20 06:16:17.722945 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 343/680] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:18.001324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:18.001945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:18.009241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.009703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.010481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.010957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.147071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.154528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-172bcce2-7642-4e99-a671-69e91c28683f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1267 microversion: 2.1 time: 0.157037 Jun 20 06:16:18.155091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 338/681] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:17 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:18.275064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:18.275796 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:18.282488 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.282943 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.283705 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.284145 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.295311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:18.295962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:18.301994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.303202 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.304279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.304768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.469559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.479796 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-b4bbc120-8be1-40b5-a364-3d05b06981a1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.208990 Jun 20 06:16:18.491686 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 344/682] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:18 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:18.495350 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.api.openstack.wsgi [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117586) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:18.495970 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.compute.api [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117586) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:18.502522 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.502991 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.503773 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.504215 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG oslo_concurrency.lockutils [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117586) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.514368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.523524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.525129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.526369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0f2dfda6-41d7-44d9-a911-d64bbf3f25b0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.234887 Jun 20 06:16:18.537639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 339/683] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:18 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:18.665479 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG nova.policy [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117586) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.672862 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO nova.api.openstack.requestlog [None req-a9f996d0-de64-459b-8377-4be3cbab3133 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1367 microversion: 2.1 time: 0.181385 Jun 20 06:16:18.673430 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: [pid: 117586|app: 0|req: 345/684] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:18 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:18.731200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:18.731833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:18.738464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.738925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.739736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:18.740178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:18.871642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:18.880309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f67ca540-379f-4f50-a489-a2f66c8737c7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.152750 Jun 20 06:16:18.881365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 340/685] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:18 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:19.169641 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:16:19.171958 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:16:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:16:19.200064 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Traceback (most recent call last): Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: timer() Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: cb(*args, **kw) Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: waiter.switch() Jun 20 06:16:19.200232 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: greenlet.error: cannot switch to a different thread Jun 20 06:16:19.496481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:19.497112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:19.503595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.504041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.504826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.505948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.635190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:19.643014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-82d96962-8390-4d0d-8059-d8971978ba88 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1314 microversion: 2.1 time: 0.150302 Jun 20 06:16:19.643584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 341/686] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:19 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:19.648227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:19.648854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:19.654490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.654936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.655690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.656121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.788987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:19.796742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:19.798237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:19.799393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b8f65257-1ef1-4199-863a-eb46641721da tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.154881 Jun 20 06:16:19.800022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 342/687] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:19 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:19.805273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:19.805880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:19.811505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.811954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.812732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:19.813172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:19.945248 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:19.952585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6799764a-e59f-4dcd-a859-d6fdc76870a0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1556 microversion: 2.1 time: 0.151619 Jun 20 06:16:19.953160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 343/688] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:19 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:20.067196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:20.067881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:20.073894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.074371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.075166 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.075612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.205738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:20.215433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-77b36e61-d8e2-486b-8949-c22ba499eb2a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.261273 Jun 20 06:16:20.216019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 344/689] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:19 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:20.220575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:20.221712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:20.229064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.229374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.230188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.230635 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.324715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6a05b66d-a1e9-4c7d-b014-22816a7fbe7f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107600 Jun 20 06:16:20.325342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 345/690] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:16:20 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/os-interface => generated 284 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:20.365873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-1b525ae6-0fb2-459c-a6a6-736753aa1acd req-44042022-8403-4ff5-93e2-2feba5571ab4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135799a-c691-4c98-af12-4cce0ab2da1a", "name": "network-vif-plugged", "status": "completed", "tag": "dd7d7a75-898c-4bff-8619-68169fbb9797"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:20.374945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-1b525ae6-0fb2-459c-a6a6-736753aa1acd req-44042022-8403-4ff5-93e2-2feba5571ab4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.375483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-1b525ae6-0fb2-459c-a6a6-736753aa1acd req-44042022-8403-4ff5-93e2-2feba5571ab4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.387418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-1b525ae6-0fb2-459c-a6a6-736753aa1acd req-44042022-8403-4ff5-93e2-2feba5571ab4 service nova] Creating event network-vif-plugged:dd7d7a75-898c-4bff-8619-68169fbb9797 for instance 6135799a-c691-4c98-af12-4cce0ab2da1a on hv-cinder-80403 Jun 20 06:16:20.392486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-1b525ae6-0fb2-459c-a6a6-736753aa1acd req-44042022-8403-4ff5-93e2-2feba5571ab4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031177 Jun 20 06:16:20.393272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 346/691] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:20.662004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:20.662875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:20.666003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:20.672688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.673305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.674227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:20.675247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:20.779377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:16:20.779607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Mon Jun 20 06:16:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 (ip 10.222.0.39) !!! Jun 20 06:16:20.959206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:20.967231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf683997-cb21-4208-90f0-0dbbe76f3d08 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1464 microversion: 2.1 time: 0.310279 Jun 20 06:16:20.978779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 347/692] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:20 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1464 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:21.080760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:21.081404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:21.087641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.088091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.088888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.089327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.326874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:21.335092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:21.336615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:21.337823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-32625f75-1dc3-4703-a696-b976d49f9fd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.369221 Jun 20 06:16:21.338388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 348/693] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:20 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:21.342892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:21.343395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:21.350357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.351066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.351859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.352309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.367969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:21.379965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:16:21.466399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cc0629a6-8513-4b3f-be8d-06748d965b02 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "DELETE /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 204 len: 0 microversion: 2.1 time: 0.126638 Jun 20 06:16:21.467008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 349/694] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:16:21 2022] DELETE /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:16:21.474423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:21.475217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:21.481188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.481715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.482558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.483310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.656771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:21.666104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a9765f37-1dde-46a0-bb14-8d8d2603fe33 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.196073 Jun 20 06:16:21.666959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 350/695] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:21 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:21.671305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:21.671934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:21.679064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.679524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.680313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.680784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.809970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:21.817351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d4995944-0240-42f9-be06-9011a23556e1 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1470 microversion: 2.1 time: 0.149675 Jun 20 06:16:21.817977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 351/696] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:21 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1470 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:21.822344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-a9e1f9f7-4f83-42d8-804c-398f290ab1be req-bb62e2ec-9f9b-40e9-af79-ff3cb16426ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d58d309-e139-4ba1-bfbb-3eb6374de542", "tag": "67e94a03-949a-423c-a8aa-c27c606120ac"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:21.830138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a9e1f9f7-4f83-42d8-804c-398f290ab1be req-bb62e2ec-9f9b-40e9-af79-ff3cb16426ed service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:21.830582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a9e1f9f7-4f83-42d8-804c-398f290ab1be req-bb62e2ec-9f9b-40e9-af79-ff3cb16426ed service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:21.841728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-a9e1f9f7-4f83-42d8-804c-398f290ab1be req-bb62e2ec-9f9b-40e9-af79-ff3cb16426ed service nova] Creating event network-changed:67e94a03-949a-423c-a8aa-c27c606120ac for instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 on hv-cinder-80403 Jun 20 06:16:21.846686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-a9e1f9f7-4f83-42d8-804c-398f290ab1be req-bb62e2ec-9f9b-40e9-af79-ff3cb16426ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.027604 Jun 20 06:16:21.847281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 352/697] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:22.356078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:22.356803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:22.369570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.370493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.371551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.372063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.513849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:22.522184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:22.523681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:22.524895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e1aa3c77-ffd8-4f94-8816-591d54643d9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.173045 Jun 20 06:16:22.525642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 353/698] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:22 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:22.683888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:22.684497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:22.690983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.691434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.692192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.693204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.823883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:22.832044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-628d7eb1-9fb8-4c4c-af9c-79962985c70c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.152023 Jun 20 06:16:22.832614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 354/699] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:22 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:22.837077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:22.837680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:22.843377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.843829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.844584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:22.845069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:22.975083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:22.982440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bcf65be3-3862-475a-b68d-673f5d4f243a tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1470 microversion: 2.1 time: 0.148800 Jun 20 06:16:22.983257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 355/700] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:22 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:23.547504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:23.548149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:23.554823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:23.555217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:23.556013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:23.556452 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:23.688090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:23.698685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:23.700243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:23.701444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5bf6f4a4-bc6b-4892-b304-3048ad7f41cb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.157846 Jun 20 06:16:23.701997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 356/701] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:23 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:23.850940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:23.851485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:23.858197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:23.858649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:23.859424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:23.859859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.061931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:24.070947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6197efbc-2fc0-4fa5-a0f4-a5a348045721 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.225565 Jun 20 06:16:24.071734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 357/702] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:23 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:24.076395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:24.077087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:24.083338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.083701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.084744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.085250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.215057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:24.229695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aad18d32-8335-42b5-a9f1-2c715e6f61fe tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1470 microversion: 2.1 time: 0.156082 Jun 20 06:16:24.230425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 358/703] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:24 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:24.330178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-2c28e52b-4b50-4563-836b-a87b4371d03b req-0ca4f37a-3440-43e6-84ca-ff9fbae4fd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71a4ef5a-d635-44a6-8c7c-b0d764df5248", "name": "network-vif-deleted", "tag": "642c9ae2-7169-4fbc-b937-5728499c1e67"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:24.346622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2c28e52b-4b50-4563-836b-a87b4371d03b req-0ca4f37a-3440-43e6-84ca-ff9fbae4fd16 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.354105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2c28e52b-4b50-4563-836b-a87b4371d03b req-0ca4f37a-3440-43e6-84ca-ff9fbae4fd16 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.377476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-2c28e52b-4b50-4563-836b-a87b4371d03b req-0ca4f37a-3440-43e6-84ca-ff9fbae4fd16 service nova] Creating event network-vif-deleted:642c9ae2-7169-4fbc-b937-5728499c1e67 for instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 on hv-cinder-80403 Jun 20 06:16:24.384543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-2c28e52b-4b50-4563-836b-a87b4371d03b req-0ca4f37a-3440-43e6-84ca-ff9fbae4fd16 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060707 Jun 20 06:16:24.393381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 359/704] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:16:24.481839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:24.482429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:24.489050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.490726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.491567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.492014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.516494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:16:24.589455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9aa76fd3-e6a7-43b5-a628-5000d68ba865 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 204 len: 0 microversion: 2.1 time: 0.111692 Jun 20 06:16:24.590084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 360/705] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:16:24 2022] DELETE /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:16:24.598231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:24.599500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:24.605078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.605525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.606282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.606724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.737952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:24.745421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5502ce05-0dc6-463d-8b44-90bd328e0219 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1515 microversion: 2.1 time: 0.151135 Jun 20 06:16:24.745989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 361/706] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:24 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:24.750341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:24.750975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:24.756559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.757078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:24.757838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:24.758276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.151499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.160790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.163753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.165048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-29ff20a9-7d9f-4dca-93fe-aeea666410be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.418125 Jun 20 06:16:25.175707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 362/707] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:24 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:25.180686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:25.181396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:25.187383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.187930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.188795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.189298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.319780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.328374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1bcb8bc7-17e1-42c6-8e56-ffe987b9a57f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.151685 Jun 20 06:16:25.328978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 363/708] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:25 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:25.333338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:25.334023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:25.339636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.340087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.340878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.341317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.345243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:25.375171 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.375616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.376053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lazy-loading 'fault' on Instance uuid 71a4ef5a-d635-44a6-8c7c-b0d764df5248 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:25.415878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.423064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-06566781-ddb9-46be-a153-9321bc084460 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1304 microversion: 2.1 time: 0.093146 Jun 20 06:16:25.423615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 364/709] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:25 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:25.762398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:25.763049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:25.769576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.770026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.771031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:25.771588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:25.899341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:25.906789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-848ef11a-e62c-47ed-82eb-af078e2d1e05 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1515 microversion: 2.1 time: 0.148218 Jun 20 06:16:25.907356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 365/710] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:25 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1515 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:26.183204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:26.183721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:26.190284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.190782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.191564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.192004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.321005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:26.328891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:26.330394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:26.331542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dd10e492-56e4-4584-af2e-1575167b59d2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.152391 Jun 20 06:16:26.332103 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 366/711] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:26 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:26.344666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:26.345298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:26.351786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.352220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.353022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.353467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.478553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:26.486671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c4e8874f-6029-4e43-bbe2-eb933b4373cf tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.145449 Jun 20 06:16:26.487234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 367/712] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:26 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:26.491570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:26.492191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:26.497709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.498159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.498910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.499342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.530031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.530483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.530954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lazy-loading 'fault' on Instance uuid 71a4ef5a-d635-44a6-8c7c-b0d764df5248 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:26.571768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:26.579134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d6c727f7-d065-46b3-a086-3b71a6b9ad64 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1304 microversion: 2.1 time: 0.090969 Jun 20 06:16:26.579705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 368/713] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:26 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1304 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:26.923855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:26.924486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:26.930948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.931915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:26.932725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:26.933163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.062400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.070687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a22f7af0-5081-40d5-a0dd-ddc67546a261 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1515 microversion: 2.1 time: 0.150836 Jun 20 06:16:27.071346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 369/714] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:26 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:27.350619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:27.351226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:27.357220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.357927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.358688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.359123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.486707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.495225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.496729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.497939 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0c06609b-6984-4838-97d5-323794dbba33 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.151886 Jun 20 06:16:27.498441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 370/715] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:27 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:27.502755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:27.503353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:27.509126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.509573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.510327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.510760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.638701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.647114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5e606f2f-4b86-46d0-9296-384a672f2874 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.147738 Jun 20 06:16:27.647675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 371/716] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:27 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:27.652067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:27.652668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:27.658345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.658819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.659582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.660019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.690859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:27.691306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:27.691753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lazy-loading 'fault' on Instance uuid 71a4ef5a-d635-44a6-8c7c-b0d764df5248 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:27.736058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:27.744042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-93f26036-4466-4a79-bf71-165ddc7d1a9f tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1304 microversion: 2.1 time: 0.095423 Jun 20 06:16:27.744613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 372/717] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:27 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:28.088142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:28.088852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.095238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.095694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.096462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.096940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.226051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.233880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-93d315d1-d30b-4f89-bade-665e152f7223 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1515 microversion: 2.1 time: 0.150239 Jun 20 06:16:28.234461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 373/718] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:28 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:28.502789 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_api:SELECT=46 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.515172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:28.515781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.521810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.522255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.523006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.523442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.651485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.659224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.660735 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.662023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-230688c4-0f98-4511-9665-7b955d150f8b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1720 microversion: 2.20 time: 0.150670 Jun 20 06:16:28.662577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 374/719] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:28 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1720 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:28.666841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:28.667440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.670446 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: DEBUG dbcounter [-] [117586] Writing DB stats nova_cell1:SELECT=56 {{(pid=117586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:28.673453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.673915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.674675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.675114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.803519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.811437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a72e0ca4-c5f8-4601-a7e2-60089bd4e897 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.147906 Jun 20 06:16:28.812007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 375/720] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:28 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:28.816316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:28.816946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:28.822680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.823140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.823884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.824318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.855399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:28.855848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:28.856290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lazy-loading 'fault' on Instance uuid 71a4ef5a-d635-44a6-8c7c-b0d764df5248 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:16:28.895715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '619ee1d4e1274269823ef8500d264852', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eacc7c8afabe4ac4a9d585ed6f2ae4ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:28.903258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3cc83d12-12b1-4a40-86cf-81497dd47a13 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 200 len: 1304 microversion: 2.1 time: 0.090225 Jun 20 06:16:28.903764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 376/721] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:28 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 1304 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:29.250898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:29.251536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:29.258255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.258713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.259486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.259935 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.399329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:29.407161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-05ffb3ce-f740-4b0c-b593-c08f216c196b tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1515 microversion: 2.1 time: 0.160172 Jun 20 06:16:29.407728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 377/722] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:29 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:29.679573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:29.680181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:29.686342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.686793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.687590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.688026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.887450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:29.895294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:29.896834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:29.898003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1df9bade-7554-4e61-80dc-08b8a549655e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1723 microversion: 2.20 time: 0.222464 Jun 20 06:16:29.898559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 378/723] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:29 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:29.902903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:29.903506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:29.909806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.910261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.911100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:29.911629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:29.926340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:30.207422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:30.215324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-103a1e59-638e-4296-a05f-81e7f7f2301b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1709 microversion: 2.1 time: 0.315795 Jun 20 06:16:30.215900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 379/724] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:29 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1709 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:30.220674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9d0e925-383b-49f6-a1fa-75ce4851563d"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:30.221824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:30.228222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.228674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.229465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.229900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.558697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9f625d88-71e0-4aa2-8145-2b580d678fd3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341602 Jun 20 06:16:30.559421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 380/725] 10.222.0.39 () {62 vars in 1363 bytes} [Mon Jun 20 06:16:30 2022] POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments => generated 188 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:16:30.563824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:30.564434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] [instance: 71a4ef5a-d635-44a6-8c7c-b0d764df5248] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:30.570945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.571350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.572112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.572550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.585566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] HTTP exception thrown: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Request method failure captured: Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 HTTP/1.1 Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBCO-B_U6tUBOwkza6KEOK0Voc18BiDZ8T-S31o9VPAo0wRcfEOf7YpcvbxDzYeeIjs6IxrOVMrb2FvkszxpDdf7ZLLxsWnBkNVaPOcLSXOCSd3WG93Yt1WYCho7vCGaPpnWpunQssPQ9gaqNhaAt_cSVAxinLAgGQcRyvDzHRnqucE Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: eacc7c8afabe4ac4a9d585ed6f2ae4ef Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesNegativeTest-1449216191 Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:16:30.587214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_eacc7c8afabe4ac4a9d585ed6f2ae4ef"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/eacc7c8afabe4ac4a9d585ed6f2ae4ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacc7c8afabe4ac4a9d585ed6f2ae4ef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/eacc7c8afabe4ac4a9d585ed6f2ae4ef"}]}] Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesNegativeTest-1449216191 Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: eacc7c8afabe4ac4a9d585ed6f2ae4ef Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesNegativeTest-1449216191 Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesNegativeTest-1449216191-project Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 619ee1d4e1274269823ef8500d264852 Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesNegativeTest-1449216191-project Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. Jun 20 06:16:30.588595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '71a4ef5a-d635-44a6-8c7c-b0d764df5248'} Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:30.589385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. Jun 20 06:16:30.590625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:30.591704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] Returning 404 to user: Instance 71a4ef5a-d635-44a6-8c7c-b0d764df5248 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:30.591704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3a2f347d-31b2-460f-8535-ec42a03d3349 tempest-VolumesNegativeTest-1449216191 tempest-VolumesNegativeTest-1449216191-project] 10.222.0.39 "GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248" status: 404 len: 111 microversion: 2.1 time: 0.028263 Jun 20 06:16:30.591704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 381/726] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:30 2022] GET /compute/v2.1/servers/71a4ef5a-d635-44a6-8c7c-b0d764df5248 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:30.593910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:30.594512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:30.600373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.600912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.601779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.602122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.672912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:30.681850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-695ee87f-2c67-4851-8d36-aae24e46605e tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 200 len: 1473 microversion: 2.1 time: 0.091299 Jun 20 06:16:30.682525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 382/727] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:30 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 1473 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:30.687092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-639a13ab-b826-4ac2-becb-f9d3dd7e7511 req-858348fc-bd8a-482f-8e3f-65dfb5cc6b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67e2ba1e-49da-4f92-b169-de4528a1a15f", "name": "network-vif-deleted", "tag": "10ea133d-eff8-4339-89bd-603b9576d4cb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:30.696059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-639a13ab-b826-4ac2-becb-f9d3dd7e7511 req-858348fc-bd8a-482f-8e3f-65dfb5cc6b8a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.696519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-639a13ab-b826-4ac2-becb-f9d3dd7e7511 req-858348fc-bd8a-482f-8e3f-65dfb5cc6b8a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.707191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-639a13ab-b826-4ac2-becb-f9d3dd7e7511 req-858348fc-bd8a-482f-8e3f-65dfb5cc6b8a service nova] Creating event network-vif-deleted:10ea133d-eff8-4339-89bd-603b9576d4cb for instance 67e2ba1e-49da-4f92-b169-de4528a1a15f on hv-cinder-80403 Jun 20 06:16:30.712552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-639a13ab-b826-4ac2-becb-f9d3dd7e7511 req-858348fc-bd8a-482f-8e3f-65dfb5cc6b8a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028860 Jun 20 06:16:30.713249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 383/728] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:30.718559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:30.719223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:30.727753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.728556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.729988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.730686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.853480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c704b10b-116f-428e-98d7-f17e817e435c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/action" status: 202 len: 0 microversion: 2.20 time: 0.138978 Jun 20 06:16:30.854101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 384/729] 10.222.0.39 () {62 vars in 1318 bytes} [Mon Jun 20 06:16:30 2022] POST /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:16:30.874095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:30.874759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:30.882185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.882614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:30.883434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:30.883875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.090921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:31.103536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:31.105913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:31.110084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-35360d7c-f0ed-4109-b8e0-081ba86f5807 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1749 microversion: 2.20 time: 0.251441 Jun 20 06:16:31.111731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 385/730] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:30 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1749 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:31.234148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:31.234983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:31.238486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:31.243034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.243503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.244286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.244794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.507149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:31.517255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-097dcd7c-8e21-47f4-a102-3e5dc685a827 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1713 microversion: 2.1 time: 0.288140 Jun 20 06:16:31.528647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 386/731] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:31 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1713 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:31.699500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:31.700225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: 67e2ba1e-49da-4f92-b169-de4528a1a15f] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:31.706177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.706731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.707559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:31.708753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:31.722547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] HTTP exception thrown: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Request method failure captured: Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f HTTP/1.1 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBH2h_fil4NFSu6BbBYV9jAar91ImlOK8qNQ9gm_Ni4ARhs8dDoL7P5yrhQ9LkttOeuOgn1pRVyZJD9W9npMli--ay7mUUVCldEld5-NOQPVP1EtlTtlyVauUhTUmhbLCVkp2TSAVzOzzADQvwYXhgq_pQX_RQDmDgNHC5nBZJDJy0 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 32eaa17777d1483ebf99b417ca9ad0b9 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:16:31.724560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32eaa17777d1483ebf99b417ca9ad0b9"}]}] Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 32eaa17777d1483ebf99b417ca9ad0b9 Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesSnapshotTestJSON-707410131-project Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b6cafb20423142db91fcca21cd19ff7d Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesSnapshotTestJSON-707410131-project Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. Jun 20 06:16:31.726399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '67e2ba1e-49da-4f92-b169-de4528a1a15f'} Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:16:31.727897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. Jun 20 06:16:31.729818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:16:31.731494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Returning 404 to user: Instance 67e2ba1e-49da-4f92-b169-de4528a1a15f could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:16:31.731494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-87f28b83-4d6b-4dd4-bd32-d7d8ae6084f7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f" status: 404 len: 111 microversion: 2.1 time: 0.030444 Jun 20 06:16:31.731494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 387/732] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:31 2022] GET /compute/v2.1/servers/67e2ba1e-49da-4f92-b169-de4528a1a15f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:16:32.131157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:32.132161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:32.138947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:32.139542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:32.140472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:32.140942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:32.300538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:32.311693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:32.313576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:32.314870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9404932a-d5c3-4c66-af86-84114716acd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1749 microversion: 2.20 time: 0.188583 Jun 20 06:16:32.315512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 388/733] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:32 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1749 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:33.334488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:33.335122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:33.341716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:33.342167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:33.342950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:33.343370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:33.483079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:33.492373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:33.493965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:33.495859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0b507ca6-fb9e-4735-9601-f9362b9b8fe0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1751 microversion: 2.20 time: 0.165112 Jun 20 06:16:33.496622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 389/734] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:33 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:34.514683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:34.515306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:34.522322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.522771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.523526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:34.523962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:34.660849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:34.669826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:34.671325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:34.672479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2cc097c7-7724-445b-a796-3c2c8ec12832 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1751 microversion: 2.20 time: 0.161679 Jun 20 06:16:34.673081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 390/735] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:34 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:35.690597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:35.691206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:35.697801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:35.698248 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:35.699007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:35.699442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:35.825352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:35.834293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:35.835812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:35.837017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-80e57340-900e-476c-a783-4ce90a835db2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1751 microversion: 2.20 time: 0.150278 Jun 20 06:16:35.837599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 391/736] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:35 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1751 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:36.855264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:36.855914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:36.862606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.863059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.863824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:36.865066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:36.998056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:37.006643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:37.008251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:37.009598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2ae1fcaa-21f3-47b6-b60f-ef6ab9faa855 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1751 microversion: 2.20 time: 0.158396 Jun 20 06:16:37.010182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 392/737] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:36 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:38.027402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:38.028040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:38.034507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:38.034965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:38.036276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:38.037015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:38.261879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:38.275798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:38.277762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:38.279030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-540872ca-75f1-43e6-9e94-facf9d6e9f84 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.255464 Jun 20 06:16:38.281101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 393/738] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:38 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:39.298894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:39.299537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:39.306496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.306959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.307742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:39.308178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:39.331363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:39.463736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:39.478871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:39.480401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:39.481604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-80c3c25c-d0be-4609-8b46-550c524e8d88 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.186673 Jun 20 06:16:39.482161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 394/739] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:39 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:40.500080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:40.500692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:40.508410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.508899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.509700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:40.510146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:40.635619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:40.644002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:40.645558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:40.646829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f7a5d410-ef1b-4134-af68-827c1737a808 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.150661 Jun 20 06:16:40.647392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 395/740] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:40 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:41.665039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:41.665772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:41.672582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.673142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.673995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:41.674505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:41.813514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:41.822803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:41.824318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:41.825569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4284135e-b44b-42d4-9bbc-590d8c89ef6c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.164525 Jun 20 06:16:41.826325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 396/741] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:41 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:42.845590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:42.846208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:42.853176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.853625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:42.854385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:42.854828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:42.987286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:42.996000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:42.997538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:42.998714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e487b197-a1a8-4163-99f3-37d19f76e980 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.157222 Jun 20 06:16:42.999481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 397/742] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:42 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:44.016599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:44.017268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:44.024053 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.024501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:44.025372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:44.025813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:44.155281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:44.164374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:44.165932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:44.167108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-069310f6-4b06-4225-81ba-b582f1292830 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.154478 Jun 20 06:16:44.167777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 398/743] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:44 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:45.185543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:45.186250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:45.193569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:45.194030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:45.194805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:45.195249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:45.325838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:45.334671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:45.336191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:45.337407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a68a5d5c-5408-41f3-b56b-682d9d0d3159 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.155811 Jun 20 06:16:45.337973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 399/744] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:45 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:45.867137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-484386291", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "networks": [{"uuid": "c530370a-2c4e-48a4-9c47-3aa1262db8e3"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:45.921153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] validate_networks() for [('c530370a-2c4e-48a4-9c47-3aa1262db8e3', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:16:46.388296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:16:46.388980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:16:46.389215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:16:46.389626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:16:46.390040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:16:46.401741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.402380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.403247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.403749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.420893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Getting quotas for project 32eaa17777d1483ebf99b417ca9ad0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:16:46.424922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Getting quotas for user b6cafb20423142db91fcca21cd19ff7d and project 32eaa17777d1483ebf99b417ca9ad0b9. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:16:46.436650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:16:46.438941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:16:46.491424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0249c534-d906-4f7e-b92f-d2914d3c0762 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628763 Jun 20 06:16:46.492448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 400/745] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:16:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:16:46.500813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:46.501475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:46.508749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.509904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.510906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:46.511722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:46.687677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:46.700613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:46.703094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:46.704554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ba43da36-95ae-4619-b9cf-b4219c1a1deb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.210882 Jun 20 06:16:46.706071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 401/746] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:46 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:46.709711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4baf91d9-2816-4a41-949e-cbdc51dd3620 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:46.710282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4baf91d9-2816-4a41-949e-cbdc51dd3620 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:47.021912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4baf91d9-2816-4a41-949e-cbdc51dd3620 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.028513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4baf91d9-2816-4a41-949e-cbdc51dd3620 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1218 microversion: 2.1 time: 0.322588 Jun 20 06:16:47.029120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 402/747] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:46 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1218 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:47.722753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:47.724350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:47.730913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.731362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.732152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:47.732882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:47.875027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.883812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.885379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:47.886531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-73a2a92b-6948-4099-bdad-954e77784102 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.167789 Jun 20 06:16:47.887083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 403/748] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:47 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:48.046614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:48.047224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:48.054094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.054833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.055649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.056091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.126310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:48.134838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-81d1e788-2e04-4dd0-97ae-f94130200b3f tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.092386 Jun 20 06:16:48.135414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 404/749] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:48 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:16:48.906359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:48.907158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:48.914141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.914592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:48.915351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:48.915787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.054938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:49.063464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:49.065019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:49.066206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1a0d189d-0fa7-446f-a7c9-a1d5b9dbdb92 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.163884 Jun 20 06:16:49.066976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 405/750] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:48 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:49.152986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:49.153647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:49.159671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.160136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.161582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:49.162028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:49.222631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:49.231591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-97a76d73-31ac-43c1-8bc4-8fb5ac2251f2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.083257 Jun 20 06:16:49.232635 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 406/751] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:49 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:50.085688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:50.086498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:50.093690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.094157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.095001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.095582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.231360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.241464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.242994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.244188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d030e9d8-7655-4892-87ba-0084e7dfebd1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.163400 Jun 20 06:16:50.244868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 407/752] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:50 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:50.249192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:50.249799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:50.256538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.257019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.257785 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:50.258226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:50.323439 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:50.331353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d9906808-c9a9-4684-badb-1eb3ec5c8ca7 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.085528 Jun 20 06:16:50.331924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 408/753] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:50 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:51.262769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:51.263490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:51.270146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.270612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.272144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.272777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.407252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.417247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.418761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.419956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-384a1eee-84dc-44bd-b330-dab9b73c63d9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.161097 Jun 20 06:16:51.420760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 409/754] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:51 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:51.424897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:51.425496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:51.432827 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.433288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.434070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:51.434511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:51.498517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:51.506174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f4b2efb9-655d-48bd-8a49-3ef996f13fdf tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.084621 Jun 20 06:16:51.506932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 410/755] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:51 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:52.437840 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:52.438539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:52.446241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.446696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.447547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.447992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.584969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.593542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.595049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.596218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cef4eb63-2977-4bf1-860f-c735053e5bd5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.162489 Jun 20 06:16:52.596802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 411/756] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:52 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:52.602605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:52.603293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:52.611574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.612037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.612865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:52.613314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:52.676129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:52.679943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:52.686898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-07e2db6e-df70-406e-8dc1-dcadd013c95a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.089037 Jun 20 06:16:52.687616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 412/757] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:52 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:53.615373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:53.616539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:53.623131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.623589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.624485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.625022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.755911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.764803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.766367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.767519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-93eed387-2df1-480a-b3d9-3ccc2a63699a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.156200 Jun 20 06:16:53.768077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 413/758] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:53 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:53.772350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:53.772971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:53.778580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.779027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.779781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:53.780221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:53.839541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:53.846774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6fcfe4ad-1b56-47b6-a1df-25d7f5a4ec3a tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.077763 Jun 20 06:16:53.847335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 414/759] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:53 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:54.785756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:54.786381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:54.793458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.793934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.794698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.795142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.921609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:54.930350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:54.931843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:54.933033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6586b6ae-4363-4de1-9932-7ddf8ea537c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.151135 Jun 20 06:16:54.933593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 415/760] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:54 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:54.938043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:54.938644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:54.944795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.945245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:54.946000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:54.946435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:55.004936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:55.012824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7d3dbaf7-00f1-4d17-891e-16f29d6e182d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1222 microversion: 2.1 time: 0.078266 Jun 20 06:16:55.013394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 416/761] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:54 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:55.952270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:55.953024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:55.961045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:55.961858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:55.963068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:55.963517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:56.097565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:56.106423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:56.108206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:56.109409 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5dbed2da-0c94-492a-9401-1ebc857493b1 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.162337 Jun 20 06:16:56.109972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 417/762] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:55 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:56.114252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:56.114851 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:56.120514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:56.121002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:56.121853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:56.122299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:56.182257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:56.190049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c33bc34f-87c2-4d2c-8e7e-6aeacdfe4e95 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1214 microversion: 2.1 time: 0.078872 Jun 20 06:16:56.190340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 418/763] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:56 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1214 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:57.127870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:57.128443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:57.130249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:57.131107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=8 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:16:57.136575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.137062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.137820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.138260 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.268770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:57.277829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:57.279334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:57.280499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b920f4e6-927b-4cb6-bb0d-ecb60f42f45e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.156852 Jun 20 06:16:57.281094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 419/764] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:57 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:57.285396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:57.285996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:57.292630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.293123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.293919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:57.294363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:57.362204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:57.371036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-afe8d53d-e6b2-46d7-a4ef-1e32a90932b8 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1214 microversion: 2.1 time: 0.088994 Jun 20 06:16:57.371793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 420/765] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:57 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:58.300584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:58.301249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:58.308658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.309174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.309958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.310405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.485967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.496026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.497951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.499424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-20de8855-e3a8-44b4-a6a3-f0b8ad5ea6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.203752 Jun 20 06:16:58.500162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 421/766] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:58 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:16:58.504518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:58.505186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:58.511128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.511589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.512393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:58.512869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:58.580476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:58.589273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-07710156-3f61-4e70-9ea6-af266d937fba tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1276 microversion: 2.1 time: 0.088121 Jun 20 06:16:58.589854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 422/767] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:58 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:16:59.517853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:59.518495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:59.525837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.526297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.527081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.527527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.742870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:59.751351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:59.752827 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:16:59.754008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e521139a-8864-46d6-84d6-3e7f6c5c901c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.240083 Jun 20 06:16:59.754578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 423/768] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:16:59 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:16:59.876687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-29d4ee99-9ebd-40bf-80fb-5a72f188bf38 req-21bbb66c-fd32-4830-a1ed-fd2f11e0f0f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc7a6de2-1211-4e64-ac85-6e1d02209ba7", "tag": "7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:16:59.885362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-29d4ee99-9ebd-40bf-80fb-5a72f188bf38 req-21bbb66c-fd32-4830-a1ed-fd2f11e0f0f4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.885814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-29d4ee99-9ebd-40bf-80fb-5a72f188bf38 req-21bbb66c-fd32-4830-a1ed-fd2f11e0f0f4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.897646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-29d4ee99-9ebd-40bf-80fb-5a72f188bf38 req-21bbb66c-fd32-4830-a1ed-fd2f11e0f0f4 service nova] Creating event network-changed:7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35 for instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 on hv-cinder-80403 Jun 20 06:16:59.903163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-29d4ee99-9ebd-40bf-80fb-5a72f188bf38 req-21bbb66c-fd32-4830-a1ed-fd2f11e0f0f4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.147457 Jun 20 06:16:59.903965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 424/769] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:16:59.909169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:16:59.909890 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:16:59.916958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.917421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:16:59.918220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:16:59.918661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:00.103839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:00.111518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a72841e1-d6e2-408e-86c1-80b6bfd76b4d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.206413 Jun 20 06:17:00.112099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 425/770] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:16:59 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:00.772883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:00.773553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:00.780140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:00.780602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:00.781437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:00.781886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:00.921344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:00.930147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:00.931679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:00.932917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a1c3b84-36e0-4664-8575-fac3e9911361 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.164015 Jun 20 06:17:00.933472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 426/771] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:00 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:01.128364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:01.128937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:01.135061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:01.135510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:01.136269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:01.136728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:01.267115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:01.275350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-abf85fe6-8834-4c16-bea0-94c591bef5ab tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.150886 Jun 20 06:17:01.275911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 427/772] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:01 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:01.950972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:01.951628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:01.954063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:01.959513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:01.959899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:01.960669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:01.961136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:02.092443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:02.101835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:02.103347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:02.104518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0345092d-55e5-4e3f-a150-74654418c6ac tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.157556 Jun 20 06:17:02.105111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 428/773] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:01 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:02.292551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:02.293122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:02.299092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:02.299549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:02.300317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:02.300790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:02.428642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:02.436090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9c1b5800-4b3e-431e-bf55-7778feafc550 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.147321 Jun 20 06:17:02.436664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 429/774] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:02 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:03.122770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:03.123385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:03.129880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:03.130428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:03.131775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:03.132353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:03.134963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:03.263683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:03.272213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:03.273742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:03.274929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-923c8864-4636-4cc5-8b4d-2b1207ab49c9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.156128 Jun 20 06:17:03.275481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 430/775] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:03 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:03.453746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:03.454354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:03.460323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:03.460813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:03.461578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:03.462014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:03.587631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:03.595069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-df55789d-2db8-4801-be1a-3e368857ef07 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.145212 Jun 20 06:17:03.595636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 431/776] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:03 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:04.293597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:04.294240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:04.300771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:04.301228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:04.301994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:04.302429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:04.434217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:04.442600 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:04.444624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:04.445814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-139bb71e-9905-400a-acf9-3fcf269f5e1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.156087 Jun 20 06:17:04.446372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 432/777] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:04 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:04.611717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:04.612481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:04.618871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:04.619329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:04.620102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:04.620547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:04.752498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:04.760529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-116f4190-f040-4d72-adab-39ae8a595e41 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.152930 Jun 20 06:17:04.761140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 433/778] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:04 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:05.467408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:05.468116 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:05.474599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:05.475133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:05.475899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:05.476341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:05.751449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:05.760432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:05.761970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:05.763132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a8ae7e13-8aa4-407c-a6a3-dbbe67f635dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.299687 Jun 20 06:17:05.763688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 434/779] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:05 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:05.776943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:05.777572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:05.783330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:05.783722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:05.784477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:05.784951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:05.913058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:05.920375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8210b3c1-2bab-46ce-b71c-52cf4ba44f84 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.147023 Jun 20 06:17:05.920947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 435/780] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:05 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:06.781739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:06.782349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:06.788946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:06.789405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:06.790180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:06.790619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:06.926643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:06.936819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:06.938336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:06.939511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-015a3dbe-324d-4aa5-86be-f1794f68c9e5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.161744 Jun 20 06:17:06.940071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 436/781] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:06 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:07.007516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f7c5600c-98b8-4157-8209-a88b1523a96c req-5097f55d-e9a4-4742-bf6b-4f82a3410b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7a6de2-1211-4e64-ac85-6e1d02209ba7", "name": "network-vif-plugged", "status": "completed", "tag": "7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:07.015664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f7c5600c-98b8-4157-8209-a88b1523a96c req-5097f55d-e9a4-4742-bf6b-4f82a3410b3e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:07.016120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f7c5600c-98b8-4157-8209-a88b1523a96c req-5097f55d-e9a4-4742-bf6b-4f82a3410b3e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:07.026626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f7c5600c-98b8-4157-8209-a88b1523a96c req-5097f55d-e9a4-4742-bf6b-4f82a3410b3e service nova] Creating event network-vif-plugged:7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35 for instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 on hv-cinder-80403 Jun 20 06:17:07.031606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f7c5600c-98b8-4157-8209-a88b1523a96c req-5097f55d-e9a4-4742-bf6b-4f82a3410b3e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090449 Jun 20 06:17:07.032404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 437/782] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:07.037437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:07.038234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:07.044148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:07.044607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:07.045414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:07.045861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:07.181225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:07.188833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-be491494-17b5-4bb9-b158-c638e3ddca63 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.155260 Jun 20 06:17:07.189394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 438/783] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:07 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:07.958304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:07.959679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:07.966087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:07.966539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:07.967296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:07.967765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:08.097755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:08.106415 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:08.108163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:08.109347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-11bbb8e0-37ce-463c-bb99-9497217a72ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.154993 Jun 20 06:17:08.109895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 439/784] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:07 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:08.206707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:08.207322 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:08.214564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:08.214999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:08.215852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:08.216327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:08.346168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:08.353602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bb1fe7d6-c8c9-46d3-94c1-d2314a936029 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.150804 Jun 20 06:17:08.354167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 440/785] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:08 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:09.129265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:09.129954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:09.136770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:09.137232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:09.138021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:09.138459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:09.277149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:09.285632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:09.287186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:09.288542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1c802c3c-b4bd-4640-9993-c3893a3e7b17 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.163306 Jun 20 06:17:09.289325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 441/786] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:09 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:09.293606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-a4d55be9-709c-4e90-b215-7a8cb2222c0c req-5f9d5ffa-b09b-46f5-86af-6629fc5c31e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "name": "network-vif-plugged", "status": "completed", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:09.301376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a4d55be9-709c-4e90-b215-7a8cb2222c0c req-5f9d5ffa-b09b-46f5-86af-6629fc5c31e1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:09.301820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a4d55be9-709c-4e90-b215-7a8cb2222c0c req-5f9d5ffa-b09b-46f5-86af-6629fc5c31e1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:09.313356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-a4d55be9-709c-4e90-b215-7a8cb2222c0c req-5f9d5ffa-b09b-46f5-86af-6629fc5c31e1 service nova] Creating event network-vif-plugged:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:17:09.319225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-a4d55be9-709c-4e90-b215-7a8cb2222c0c req-5f9d5ffa-b09b-46f5-86af-6629fc5c31e1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027951 Jun 20 06:17:09.319976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 442/787] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:17:09.371608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:09.372332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:09.378569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:09.379028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:09.379794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:09.380236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:09.512829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:09.520182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-08bff696-5750-49a5-9280-20c5e76b8d0d tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.152724 Jun 20 06:17:09.520759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 443/788] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:09 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:10.306844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:10.307450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:10.313874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:10.314325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:10.315083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:10.315525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:10.444885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:10.453396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:10.454899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:10.456104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-890f55e1-8f03-4144-94d9-f08127fb7d1c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.153117 Jun 20 06:17:10.456667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 444/789] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:10 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:10.537383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:10.537994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:10.543979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:10.544437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:10.545247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:10.545692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:10.674216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:10.682336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ec450ad7-74e3-4af9-86fd-79dcb50b9a71 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1318 microversion: 2.1 time: 0.148869 Jun 20 06:17:10.682903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 445/790] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:10 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:11.475190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:11.475804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:11.482570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.483028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.483796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.484238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.610379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:11.618899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:11.620404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:11.621597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-341f544e-2406-43f8-b0b8-a613ed88732f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.150921 Jun 20 06:17:11.622168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 446/791] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:11 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:11.698707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:11.699349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:11.705318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.705773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.706588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.706978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.835291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:11.842683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b0f62254-bf92-4f46-849c-47ac26cdbfa1 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1507 microversion: 2.1 time: 0.147657 Jun 20 06:17:11.843241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 447/792] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:11 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:11.858743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dfe90f0-0207-40b9-9011-05c1ff512336", "device": "/dev/sdb"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:11.861197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:11.867105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.867560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.868321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:11.868776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:11.871288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:12.676916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-914f8a08-158d-463d-b483-8456c6b9ced2 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "POST /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.821807 Jun 20 06:17:12.678340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 448/793] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:17:11 2022] POST /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7/os-volume_attachments => generated 194 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:12.683571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:12.684262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:12.690520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:12.690971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:12.691732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:12.692168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:12.827920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:12.836442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:12.837984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:12.839150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a06451b8-5d58-475f-ab43-3af8b344edcb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.159718 Jun 20 06:17:12.839705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 449/794] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:12 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:17:13.857871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:13.858502 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:13.865440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:13.865907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:13.866674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:13.867112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:13.995454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:14.003845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:14.006080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:14.007505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eacccef1-5ccf-438d-a835-7f00544ebf2a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1807 microversion: 2.20 time: 0.153761 Jun 20 06:17:14.008070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 450/795] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:13 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:17:15.022340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea98b0a2-2222-48c4-bd1e-d43927bedb4b"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:15.023523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:15.029558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:15.030016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:15.030791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:15.031233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.234800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dca069b8-9036-4cd6-9f3b-0f729ef1985c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.314333 Jun 20 06:17:16.235722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 451/796] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:17:14 2022] POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments => generated 194 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:16.240673 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:16.241453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:16.247712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.248220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.249019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:16.249459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:16.387089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:16.395368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:16.397508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:16.398672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-542eddc7-62fe-4746-9264-e8fc5403db2d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1794 microversion: 2.20 time: 0.162205 Jun 20 06:17:16.399223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 452/797] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:17:16 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1794 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:17:19.227914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:19.228565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:19.235647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.236097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:19.236930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.237368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:19.370041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:19.377744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9e604765-8d71-4606-83bb-c7a29666cc42 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1454 microversion: 2.1 time: 0.154444 Jun 20 06:17:19.378313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 453/798] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:19 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:19.394178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:19.394785 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:19.401125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.401587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:19.402354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:19.402794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:19.538683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:19.546180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dc9366ff-12b9-4816-b086-d61c22676a7e tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1454 microversion: 2.1 time: 0.155621 Jun 20 06:17:19.546741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 454/799] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:19 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1454 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:21.488667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-c7d6e928-10a6-4154-b4c3-c86fa5823fcd req-18d72941-b591-491f-9a44-d41e20e1303b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6135799a-c691-4c98-af12-4cce0ab2da1a", "tag": "dd7d7a75-898c-4bff-8619-68169fbb9797"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:21.498077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c7d6e928-10a6-4154-b4c3-c86fa5823fcd req-18d72941-b591-491f-9a44-d41e20e1303b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:21.498459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c7d6e928-10a6-4154-b4c3-c86fa5823fcd req-18d72941-b591-491f-9a44-d41e20e1303b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:21.510519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-c7d6e928-10a6-4154-b4c3-c86fa5823fcd req-18d72941-b591-491f-9a44-d41e20e1303b service nova] Creating event network-changed:dd7d7a75-898c-4bff-8619-68169fbb9797 for instance 6135799a-c691-4c98-af12-4cce0ab2da1a on hv-cinder-80403 Jun 20 06:17:21.515568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-c7d6e928-10a6-4154-b4c3-c86fa5823fcd req-18d72941-b591-491f-9a44-d41e20e1303b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030994 Jun 20 06:17:21.516278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 455/800] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:30.041886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:30.042925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:30.049158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.049612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.050387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.050833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.073539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'flavor' on Instance uuid 8b76e034-2305-4617-b97c-f80419ff97c7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:30.193552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3e004a2a-6be4-452d-9307-26b8b67fee93 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/action" status: 200 len: 32 microversion: 2.1 time: 0.157204 Jun 20 06:17:30.194151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 456/801] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:17:30 2022] POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:17:30.203239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:30.203928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:30.210576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.210971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.211732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:30.212170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:30.345521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:30.354952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1d9c8705-9122-45b2-afae-fcaed5fabf8a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.155621 Jun 20 06:17:30.355526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 457/802] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:30 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:31.372134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:31.372795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:31.379393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:31.379873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:31.380640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:31.381123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:31.510379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:31.519051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-415d7a76-e6c4-4177-8c9c-75ecbddd65e6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.150777 Jun 20 06:17:31.519650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 458/803] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:31 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:32.536348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:32.537012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:32.539336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=62 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:32.544752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:32.545211 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:32.545977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:32.546414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:32.755392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:32.763967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2bc906f3-045c-4d1c-8353-98b5687c39f6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.231488 Jun 20 06:17:32.764794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 459/804] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:32 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:33.781244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:33.781911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:33.788358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:33.788836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:33.789613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:33.790044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:33.925017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:33.927201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:33.935659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-32002763-78e9-4351-afbd-d29fb0a14304 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.158317 Jun 20 06:17:33.936232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 460/805] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:33 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:34.954077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:34.954912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:34.966084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:34.966838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:34.968122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:34.968871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:35.102087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:35.110269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf10bd2d-3b5d-490e-b884-9da60a6ffaf5 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.160334 Jun 20 06:17:35.110839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 461/806] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:34 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:36.126641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:36.127257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:36.134556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:36.134906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:36.137167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:36.137723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:36.270372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:36.279152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa01b337-f24c-4a18-aa50-d0131c9e688c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.156369 Jun 20 06:17:36.279750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 462/807] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:36 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:37.169484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:37.170061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:37.176305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.176994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.177671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.178105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.258347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lazy-loading 'services' on Instance uuid cc7a6de2-1211-4e64-ac85-6e1d02209ba7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:37.330325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-92ba08e1-f4da-4f07-b8a8-a794c8bc0f66 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7/os-volume_attachments/4dfe90f0-0207-40b9-9011-05c1ff512336" status: 202 len: 0 microversion: 2.1 time: 0.164545 Jun 20 06:17:37.330993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 463/808] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:37 2022] DELETE /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7/os-volume_attachments/4dfe90f0-0207-40b9-9011-05c1ff512336 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:17:37.336001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:37.336713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:37.343063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.343533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.344307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:37.344776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:37.497678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:37.505626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-48eaabd5-7763-4f41-9447-052ea450b147 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.173495 Jun 20 06:17:37.506134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 464/809] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:37 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:38.523421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:38.524084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:38.530454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:38.530905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:38.531672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:38.532103 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:38.667282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:38.675330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-efa5883c-a5a8-4e9d-9857-f42733fd1054 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.156571 Jun 20 06:17:38.675834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 465/810] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:38 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:39.501618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:39.502122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:39.509212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.509672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.510473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.510915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.536175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:17:39.612872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5c79759e-95b1-4009-aa01-1166b71aae24 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "DELETE /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 204 len: 0 microversion: 2.1 time: 0.114766 Jun 20 06:17:39.613451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 466/811] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:17:39 2022] DELETE /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:17:39.622022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:39.622718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:39.628450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.628948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.629711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.630143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.757339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:39.764726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-52e4b4fd-775a-405d-b4b5-757b439dfe62 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1513 microversion: 2.1 time: 0.146720 Jun 20 06:17:39.765299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 467/812] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:39 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1513 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:39.769733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:39.770335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:39.776928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.777380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.778135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:39.778571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:39.905679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:39.913744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1aecfe2b-a11a-494c-91a5-9f41ebe890fa tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.147342 Jun 20 06:17:39.914347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 468/813] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:39 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:40.782468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:40.783094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:40.789756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.790213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:40.790982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.791719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:40.916808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:40.924324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-addc43b7-6013-4e80-a4af-d2ab2aa508b4 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1513 microversion: 2.1 time: 0.145873 Jun 20 06:17:40.924931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 469/814] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:40 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1513 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:40.930471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:40.931093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:40.937105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.937564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:40.938349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:40.938793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:41.066010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:41.074285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4959bd9f-21fd-4451-aa6a-049b3db67d8d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.147903 Jun 20 06:17:41.074854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 470/815] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:40 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:41.943611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:41.944834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:41.951266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:41.951720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:41.952491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:41.952954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.153862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:42.161892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1bbbb3be-890a-491b-a70a-11534bf54738 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1513 microversion: 2.1 time: 0.222166 Jun 20 06:17:42.162473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 471/816] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:41 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:42.167569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:42.168172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:42.174032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:42.174491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.175268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:42.175784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.387072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:42.395076 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ff4cdeaf-3553-4f0a-9fd6-eff4aad87ab4 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.231563 Jun 20 06:17:42.395656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 472/817] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:42 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:42.595104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-3a1001b2-ab26-488b-93e4-2a2004b63d16 req-531e7590-f34f-437f-b0d6-08e28cf68d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc7a6de2-1211-4e64-ac85-6e1d02209ba7", "name": "network-vif-deleted", "tag": "7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:42.606091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-3a1001b2-ab26-488b-93e4-2a2004b63d16 req-531e7590-f34f-437f-b0d6-08e28cf68d5e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:42.606539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-3a1001b2-ab26-488b-93e4-2a2004b63d16 req-531e7590-f34f-437f-b0d6-08e28cf68d5e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:42.620267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-3a1001b2-ab26-488b-93e4-2a2004b63d16 req-531e7590-f34f-437f-b0d6-08e28cf68d5e service nova] Creating event network-vif-deleted:7d3bf3e2-0e70-4a6b-aab3-dfbe717d7e35 for instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 on hv-cinder-80403 Jun 20 06:17:42.626572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-3a1001b2-ab26-488b-93e4-2a2004b63d16 req-531e7590-f34f-437f-b0d6-08e28cf68d5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035387 Jun 20 06:17:42.627287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 473/818] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:17:43.179959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:43.180715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:43.187391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.187848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.188612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.189080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.220439 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.220929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.221383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lazy-loading 'fault' on Instance uuid cc7a6de2-1211-4e64-ac85-6e1d02209ba7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:17:43.266900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6cafb20423142db91fcca21cd19ff7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '32eaa17777d1483ebf99b417ca9ad0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:43.275738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a2dd8a01-5f48-4a10-9504-7b5be752c0d5 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 200 len: 1308 microversion: 2.1 time: 0.100353 Jun 20 06:17:43.277376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 474/819] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:43 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:43.412734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:43.413600 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:43.419790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.420254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.421046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:43.421489 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:43.436590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:43.564080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:43.572930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-16537169-a04f-4ef7-95e6-0694848a4656 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.164082 Jun 20 06:17:43.573513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 475/820] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:43 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:44.294081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:44.294773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] [instance: cc7a6de2-1211-4e64-ac85-6e1d02209ba7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:44.301139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.301596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.302352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.302787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.317804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] HTTP exception thrown: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Request method failure captured: Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 HTTP/1.1 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBH2h_fil4NFSu6BbBYV9jAar91ImlOK8qNQ9gm_Ni4ARhs8dDoL7P5yrhQ9LkttOeuOgn1pRVyZJD9W9npMli--ay7mUUVCldEld5-NOQPVP1EtlTtlyVauUhTUmhbLCVkp2TSAVzOzzADQvwYXhgq_pQX_RQDmDgNHC5nBZJDJy0 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 32eaa17777d1483ebf99b417ca9ad0b9 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:17:44.319445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32eaa17777d1483ebf99b417ca9ad0b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/32eaa17777d1483ebf99b417ca9ad0b9"}]}] Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 32eaa17777d1483ebf99b417ca9ad0b9 Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-707410131 Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesSnapshotTestJSON-707410131-project Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b6cafb20423142db91fcca21cd19ff7d Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesSnapshotTestJSON-707410131-project Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. Jun 20 06:17:44.321061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'cc7a6de2-1211-4e64-ac85-6e1d02209ba7'} Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:44.321887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. Jun 20 06:17:44.323123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:44.324309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] Returning 404 to user: Instance cc7a6de2-1211-4e64-ac85-6e1d02209ba7 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:44.324309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8e254c5f-eee2-4243-993e-284906b21de0 tempest-VolumesSnapshotTestJSON-707410131 tempest-VolumesSnapshotTestJSON-707410131-project] 10.222.0.39 "GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7" status: 404 len: 111 microversion: 2.1 time: 0.030636 Jun 20 06:17:44.324309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 476/821] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:44 2022] GET /compute/v2.1/servers/cc7a6de2-1211-4e64-ac85-6e1d02209ba7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:17:44.590176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:44.590790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:44.596718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.597191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.597964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:44.598391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:44.727425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:44.735643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e8fb21c7-8a65-4e48-b8f4-fb17af66ece6 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.149231 Jun 20 06:17:44.736267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 477/822] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:44 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:45.753043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:45.753811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:45.761380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:45.762134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:45.763185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:45.763736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:45.908976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:45.917650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8f98f5f9-5ff4-4809-bbe5-37875d7fe363 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.168746 Jun 20 06:17:45.918217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 478/823] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:45 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:46.935505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:46.936171 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:46.942844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.943303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:46.944733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:46.945182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:47.071320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:47.079297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f3e75399-9bfe-482b-a245-2ffaf1f77e5f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.147710 Jun 20 06:17:47.079873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 479/824] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:46 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:48.096489 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:48.097151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:48.103765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:48.104218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:48.105035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:48.105477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:48.233963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:48.242634 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-10ebaec3-81c7-43d9-be6d-5316a2a7d8ee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.150134 Jun 20 06:17:48.243204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 480/825] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:48 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:49.260093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:49.260806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:49.267161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:49.267670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:49.268437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:49.268907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:49.399865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:49.407819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-537118ff-b7b9-46c0-bfc4-569a5638e65c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.152245 Jun 20 06:17:49.408383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 481/826] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:49 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:50.424884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:50.425520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:50.432647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:50.433136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:50.433905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:50.434347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:50.565366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:50.574292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-64820e9c-0efd-4804-890b-19952d167cee tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.153262 Jun 20 06:17:50.574922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 482/827] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:50 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:51.590665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:51.591366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:51.597818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.598275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.599044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:51.599483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:51.727979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:51.736152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6af5218e-b2b3-40bc-95e7-586d21805c17 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.149346 Jun 20 06:17:51.736737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 483/828] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:51 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:52.754447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:52.755087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:52.763617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.764079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.765173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:52.765817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:52.900650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:52.908679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-99830572-42ef-42fd-ac3c-8ba7ab4cb966 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.158284 Jun 20 06:17:52.909216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 484/829] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:52 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:17:53.925112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:53.925763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:53.932975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:53.933434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:53.934203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:53.934653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:54.062581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:54.070573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-903fd707-adb6-446b-b013-e5962a8a2e48 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1736 microversion: 2.1 time: 0.149487 Jun 20 06:17:54.071144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 485/830] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:53 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:55.087783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:55.088384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:55.095037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.095510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.096275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.096736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.239849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:55.248501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e48ba6df-f597-4b49-856b-830b7aa1656d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1716 microversion: 2.1 time: 0.165034 Jun 20 06:17:55.249114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 486/831] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:55 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1716 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:55.303986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:55.304528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:55.310597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.311062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.311833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.312281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.394788 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] HTTP exception thrown: Cannot 'detach_volume' instance 8b76e034-2305-4617-b97c-f80419ff97c7 while it is in vm_state rescued Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Request method failure captured: Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments/ea98b0a2-2222-48c4-bd1e-d43927bedb4b HTTP/1.1 Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-J8yVqXlvOU9pICRZquWgc6kRnsz6Lcq0D6hxi4Vrduz-utYb-xv1OmgyPq5UmHKsPSHOTR3x-KoqzIoSAh3iEjRh10PIWIz6ednYSLb-_geiar9iS2pa1PxXPbHeTvRJq4oGfGcJQayLtEH2kL4L07-iejUc1D8xrf6uPNHakhLA Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:17:55.396333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}] Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: e1516d2903414b7caf082c32dcdac3eb Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:17:55.398134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Cannot 'detach_volume' instance 8b76e034-2305-4617-b97c-f80419ff97c7 while it is in vm_state rescued Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'server_id': '8b76e034-2305-4617-b97c-f80419ff97c7', 'id': 'ea98b0a2-2222-48c4-bd1e-d43927bedb4b'} Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:17:55.398954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8b76e034-2305-4617-b97c-f80419ff97c7 while it is in vm_state rescued Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8b76e034-2305-4617-b97c-f80419ff97c7 while it is in vm_state rescued Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:17:55.400477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Returning 409 to user: Cannot 'detach_volume' instance 8b76e034-2305-4617-b97c-f80419ff97c7 while it is in vm_state rescued {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:17:55.401696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-34097a04-7c24-4957-914c-9ee6bd455862 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments/ea98b0a2-2222-48c4-bd1e-d43927bedb4b" status: 409 len: 152 microversion: 2.1 time: 0.098558 Jun 20 06:17:55.401696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 487/832] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:17:55 2022] DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments/ea98b0a2-2222-48c4-bd1e-d43927bedb4b => generated 152 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 20 06:17:55.406259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:17:55.406796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:55.413120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.413583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.414357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.414801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.484670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e6ea1bf5-3787-48d9-bc4c-73b2dc9d09e3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/action" status: 202 len: 0 microversion: 2.1 time: 0.081709 Jun 20 06:17:55.485432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 488/833] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:17:55 2022] POST /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:17:55.494310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:55.495456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:55.502153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.502666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.503545 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:55.504783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:55.635104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:55.643299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-292317f5-a91a-44a7-bd20-120f796c16a3 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.153641 Jun 20 06:17:55.643854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 489/834] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:55 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:56.660386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:56.661105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:56.667530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.667980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.668768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:56.669204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:56.796314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:56.805351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-77f66d7f-6823-44a2-8817-8eb57ce0c039 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.148755 Jun 20 06:17:56.805919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 490/835] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:56 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:57.825342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:57.825957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:57.832406 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.832895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.833653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:57.835169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:57.968814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:57.971221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:17:57.978790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d7778732-5997-4eed-99bf-69c561d5bf35 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.157368 Jun 20 06:17:57.979368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 491/836] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:57 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:17:58.997009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:17:58.997672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:17:59.005590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:59.006231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:59.007173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:17:59.007632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:17:59.135622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:17:59.143587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-827f5d97-b6ed-448e-86c7-6114e973114c tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.150592 Jun 20 06:17:59.144154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 492/837] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:17:58 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:00.160975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:00.161658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:00.168480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:00.168977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:00.169748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:00.170186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:00.210956 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:18:00.211591 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:18:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:18:00.316262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:00.326160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b21253ab-cacd-45d7-b616-22768b64b635 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.169350 Jun 20 06:18:00.326728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 493/838] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:00 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:01.345381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:01.346131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:01.352925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.353382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.354160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:01.354585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:01.486918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:01.494974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e421d08e-ab0e-4be8-885c-1408b639af9f tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.154346 Jun 20 06:18:01.495527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 494/839] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:01 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:02.511842 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:02.512846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:02.520160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:02.520622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:02.521500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:02.521950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:02.657375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:02.665714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ec6dc28c-25c3-4da5-9da8-48e807f42f41 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.157674 Jun 20 06:18:02.665966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 495/840] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:02 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:03.683347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:03.684044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:03.686806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:03.695705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:03.695705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.695705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:03.695705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:03.833082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:03.843060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-92b85c91-ef65-414e-a91b-8359ab8301cd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1724 microversion: 2.1 time: 0.164659 Jun 20 06:18:03.849661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 496/841] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:03 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:04.860268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:04.860910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:04.867350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.867811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.869267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:04.869661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:04.994989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:05.003113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c3bf4b50-62fd-4611-ae77-100fa682bd24 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1730 microversion: 2.1 time: 0.146971 Jun 20 06:18:05.003706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 497/842] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:04 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1730 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:05.019132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:05.019633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:05.025745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.026201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.026979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.027427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.102961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f4c6f2f3-c734-43b2-ae12-c097eafa864b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086971 Jun 20 06:18:05.103595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 498/843] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:18:05 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:05.969467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-d72c45d8-7de1-414b-a155-d6bce412acc1 req-8404f777-0714-431e-82e2-6cc983a1da2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:05.980444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-d72c45d8-7de1-414b-a155-d6bce412acc1 req-8404f777-0714-431e-82e2-6cc983a1da2c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:05.981187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-d72c45d8-7de1-414b-a155-d6bce412acc1 req-8404f777-0714-431e-82e2-6cc983a1da2c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:05.994068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-d72c45d8-7de1-414b-a155-d6bce412acc1 req-8404f777-0714-431e-82e2-6cc983a1da2c service nova] Creating event network-changed:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:18:05.999863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-d72c45d8-7de1-414b-a155-d6bce412acc1 req-8404f777-0714-431e-82e2-6cc983a1da2c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034554 Jun 20 06:18:06.000469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 499/844] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:08.015252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-57f3e0ac-23e4-4585-9748-7ab0f6260252 req-58e0dfaf-2402-45a8-bf32-721266354181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:08.023547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-57f3e0ac-23e4-4585-9748-7ab0f6260252 req-58e0dfaf-2402-45a8-bf32-721266354181 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:08.023992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-57f3e0ac-23e4-4585-9748-7ab0f6260252 req-58e0dfaf-2402-45a8-bf32-721266354181 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:08.035084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-57f3e0ac-23e4-4585-9748-7ab0f6260252 req-58e0dfaf-2402-45a8-bf32-721266354181 service nova] Creating event network-changed:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:18:08.040782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-57f3e0ac-23e4-4585-9748-7ab0f6260252 req-58e0dfaf-2402-45a8-bf32-721266354181 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029221 Jun 20 06:18:08.041413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 500/845] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:13.497160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:13.497835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:13.504766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:13.505230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:13.506011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:13.506456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:13.589231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lazy-loading 'services' on Instance uuid db62494c-25f7-4eab-8c22-5c48182d5a5a {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:13.659476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7ec8a73b-3440-4026-baf8-e19641388c1f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments/3a345f1f-f0aa-4e0c-8cc3-12b4dda8484b" status: 202 len: 0 microversion: 2.1 time: 0.167562 Jun 20 06:18:13.660253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 501/846] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:18:13 2022] DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments/3a345f1f-f0aa-4e0c-8cc3-12b4dda8484b => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:18:15.826962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a42100b1-6317-45e8-9a38-5e3939be8d9b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:15.833941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a42100b1-6317-45e8-9a38-5e3939be8d9b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.834398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a42100b1-6317-45e8-9a38-5e3939be8d9b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.858169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a42100b1-6317-45e8-9a38-5e3939be8d9b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Going to try to stop instance {{(pid=117585) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 20 06:18:15.900144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a42100b1-6317-45e8-9a38-5e3939be8d9b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.076551 Jun 20 06:18:15.900736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 502/847] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:18:15 2022] POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:18:15.908685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:15.909408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:15.916168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.916625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:15.917422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:15.917871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:16.049700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:16.057130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-74ae86aa-fa23-4585-a756-6ab556bfa927 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.152242 Jun 20 06:18:16.057697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 503/848] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:15 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:17.074442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:17.075094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:17.081762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.082224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.082999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:17.083447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:17.220326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:17.228752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8cc0dc24-6830-4862-aff1-36f7b3bbef59 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.158063 Jun 20 06:18:17.229327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 504/849] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:17 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:18.246757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:18.247442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:18.253841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:18.254293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:18.255064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:18.255507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:18.384845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:18.392239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6d19ae60-a877-4931-b4a6-6bd0cb59ebf3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.149976 Jun 20 06:18:18.392838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 505/850] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:18 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:19.409505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:19.410291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:19.416604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:19.417093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:19.417860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:19.418301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:19.559991 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:19.567514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9fbe8e18-cc5d-4225-9e4d-d924915ca8fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.162067 Jun 20 06:18:19.568080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 506/851] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:19 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:20.584458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:20.585138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:20.592051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:20.592510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:20.593313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:20.593760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:20.723781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:20.731774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b3270d51-3609-4072-907b-ff401a8156dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.150963 Jun 20 06:18:20.732342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 507/852] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:20 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:21.749214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:21.749828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:21.756217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.756668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.757455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:21.757891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:21.772382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:21.888146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:21.895570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70236476-1f5c-4259-b2e5-1ec9586d680b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.150199 Jun 20 06:18:21.896134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 508/853] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:21 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:22.912365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:22.913129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:22.920302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:22.920795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:22.921563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:22.922005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:23.049039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:23.057189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d0583704-4e13-48bd-ab58-0d80d2b4c39f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.148755 Jun 20 06:18:23.057764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 509/854] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:22 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:24.074814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:24.075475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:24.082034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:24.082496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.083268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:24.083713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:24.215047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:24.223668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-698e0ee7-a44a-43e8-9ee6-16f49d16f3b6 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.153896 Jun 20 06:18:24.225848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 510/855] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:24 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:25.244073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:25.244740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:25.251140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.251589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.252357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:25.252823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:25.380254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:25.388351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-922ad137-fe73-4310-8d21-7088da122b02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.148129 Jun 20 06:18:25.388969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 511/856] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:25 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:26.405669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:26.406354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:26.412718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.413191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.413951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:26.415105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:26.544581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:26.552293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-52fcf48c-e533-4cfb-a566-2f4c8dda4159 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.150504 Jun 20 06:18:26.552905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 512/857] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:26 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:27.569508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:27.570178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:27.577051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.577508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.578277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:27.578718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:27.710859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:27.718435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b72c3e7b-cd73-41fd-86cb-204e791b6412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.152828 Jun 20 06:18:27.719005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 513/858] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:27 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:28.735717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:28.736366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:28.743291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.743854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.744633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:28.745111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:28.871545 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:28.878981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bc64b9ad-df75-4b48-9d53-d739ce9db5cd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.147563 Jun 20 06:18:28.879551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 514/859] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:28 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:29.896645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:29.897334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:29.904566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:29.905057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:29.905829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:29.906272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:30.280182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:30.287846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5f2d9ea6-3b10-4a8f-92ba-0981723f026f tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.395230 Jun 20 06:18:30.288734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 515/860] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:29 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:31.305915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:31.307274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:31.313837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:31.314296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.315067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:31.315510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:31.442355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:31.450113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4f289522-1672-4c2a-8083-0682dc8e6e1c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1677 microversion: 2.1 time: 0.148191 Jun 20 06:18:31.450687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 516/861] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:31 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:32.468007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:32.468636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:32.475146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.475602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.476369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.476843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.617006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.624627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7636b0cc-5efc-4868-b599-af3f99eae95a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1654 microversion: 2.1 time: 0.160514 Jun 20 06:18:32.625230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 517/862] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:32 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1654 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:32.640896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bba74903-1255-4299-859e-2bbd7a057cb8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:32.646769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bba74903-1255-4299-859e-2bbd7a057cb8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.647224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bba74903-1255-4299-859e-2bbd7a057cb8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.669059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bba74903-1255-4299-859e-2bbd7a057cb8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Going to try to start instance {{(pid=117585) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 20 06:18:32.709071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bba74903-1255-4299-859e-2bbd7a057cb8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action" status: 202 len: 0 microversion: 2.1 time: 0.071405 Jun 20 06:18:32.709580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 518/863] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:18:32 2022] POST /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/action => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:18:32.718612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:32.719317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:32.725496 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.725955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.726729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:32.727170 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:32.906128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:32.914012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-283187a7-ea85-4668-8324-4bdb6dbd94a7 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1663 microversion: 2.1 time: 0.199372 Jun 20 06:18:32.914912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 519/864] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:32 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1663 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:33.931920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:33.932618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:33.934987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=48 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:33.940505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.940993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:33.941977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:33.942525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:34.089286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:34.096685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-df8bc015-3f2a-4de9-ba4e-b379cdacbc8b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1663 microversion: 2.1 time: 0.168862 Jun 20 06:18:34.097275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 520/865] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:33 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1663 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:35.105884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.106759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.112644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.113125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.113889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.114337 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.137892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eec0a7f7-636b-4b55-9fa1-f1fb8f59a030 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/ips" status: 200 len: 149 microversion: 2.1 time: 0.265622 Jun 20 06:18:35.138370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 521/866] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:18:34 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/ips => generated 149 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:35.142668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.143347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.149012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.149494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.150340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.150790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.278552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:35.286056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0b6bbad8-1567-47f4-ab34-ed14707f9ea3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1667 microversion: 2.1 time: 0.146763 Jun 20 06:18:35.286614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 522/867] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:35 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1667 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:35.292497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "055c4560-044b-4a5c-9f94-e875f159af44"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:35.293662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.299464 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.299929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.300692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.301150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.381071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: POST /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/os-volume_attachments HTTP/1.1 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 74 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:18:35.382792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {"volumeAttachment": {"volumeId": "055c4560-044b-4a5c-9f94-e875f159af44"}} Jun 20 06:18:35.384342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'server_id': '0d58d309-e139-4ba1-bfbb-3eb6374de542', 'body': {'volumeAttachment': {'volumeId': '055c4560-044b-4a5c-9f94-e875f159af44'}}} Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:35.385175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:35.386391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 400 to user: Invalid volume: volume 055c4560-044b-4a5c-9f94-e875f159af44 is already attached to instances: c0338365-19aa-44e3-bf8b-fa704eb7ce10 {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4e3937b9-234a-480e-854d-4b40a12c418f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096693 Jun 20 06:18:35.387622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 523/868] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:18:35 2022] POST /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:18:35.392779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.393361 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.399071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.400147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.400945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.401386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.416787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:35.427905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:35.502201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-829212d9-f5f5-4ad7-a1e9-962487a901be tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 204 len: 0 microversion: 2.1 time: 0.112702 Jun 20 06:18:35.502781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 524/869] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:18:35 2022] DELETE /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:18:35.511394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:35.512250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:35.518376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.518838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.519617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:35.520065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:35.650284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:35.657718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4d46ba33-adab-4cab-b128-0cf02f974648 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1681 microversion: 2.1 time: 0.150600 Jun 20 06:18:35.658280 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 525/870] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:35 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:36.675357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:36.676080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:36.683967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:36.684418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:36.685239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:36.685683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:36.838344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:36.848070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70e78c8a-deed-4d6c-997e-56dce9f9dc61 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1681 microversion: 2.1 time: 0.176592 Jun 20 06:18:36.848653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 526/871] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:36 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:37.869596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:37.870294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:37.876996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:37.877461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:37.878241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:37.878687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:38.169145 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:38.176771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf1217e6-52bf-482f-be5d-e8796d55e706 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1681 microversion: 2.1 time: 0.311628 Jun 20 06:18:38.177352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 527/872] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:37 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1681 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:38.675573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-01a1898c-5280-4d73-a772-7483cd314a5d req-dc19ca40-effb-4347-80b7-0e57542ca724 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d58d309-e139-4ba1-bfbb-3eb6374de542", "name": "network-vif-deleted", "tag": "67e94a03-949a-423c-a8aa-c27c606120ac"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:38.683822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-01a1898c-5280-4d73-a772-7483cd314a5d req-dc19ca40-effb-4347-80b7-0e57542ca724 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:38.684508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-01a1898c-5280-4d73-a772-7483cd314a5d req-dc19ca40-effb-4347-80b7-0e57542ca724 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:38.696034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-01a1898c-5280-4d73-a772-7483cd314a5d req-dc19ca40-effb-4347-80b7-0e57542ca724 service nova] Creating event network-vif-deleted:67e94a03-949a-423c-a8aa-c27c606120ac for instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 on hv-cinder-80403 Jun 20 06:18:38.702173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-01a1898c-5280-4d73-a772-7483cd314a5d req-dc19ca40-effb-4347-80b7-0e57542ca724 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030105 Jun 20 06:18:38.703542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 528/873] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:39.166809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:39.167643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:39.175562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.176086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.177284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.177792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.208761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-63880e3f-261b-4f8e-bb7d-7da5e0ec8096 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments/e9d0e925-383b-49f6-a1fa-75ce4851563d" status: 200 len: 194 microversion: 2.20 time: 0.047951 Jun 20 06:18:39.209396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 529/874] 10.222.0.39 () {60 vars in 1453 bytes} [Mon Jun 20 06:18:39 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments/e9d0e925-383b-49f6-a1fa-75ce4851563d => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:18:39.218076 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:39.218701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:39.225234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.225685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.226463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.226906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.262803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.263268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.263728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lazy-loading 'fault' on Instance uuid 0d58d309-e139-4ba1-bfbb-3eb6374de542 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:39.324331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:39.331952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-21d5c726-f30a-4e53-8dc2-0a90af2a8ffb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 200 len: 1331 microversion: 2.1 time: 0.121213 Jun 20 06:18:39.332515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 530/875] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:39 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 1331 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:39.337611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:39.338384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:39.344495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.344980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.345941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.346378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.435568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lazy-loading 'services' on Instance uuid 7a94bb25-2c14-43f3-91a3-1f75da735166 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:39.520917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2133db7e-1f39-415e-828b-ca414d1ec833 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments/e9d0e925-383b-49f6-a1fa-75ce4851563d" status: 202 len: 0 microversion: 2.20 time: 0.186773 Jun 20 06:18:39.521561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 531/876] 10.222.0.39 () {60 vars in 1456 bytes} [Mon Jun 20 06:18:39 2022] DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments/e9d0e925-383b-49f6-a1fa-75ce4851563d => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:18:39.531050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:39.532380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:39.541641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.542396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.543949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:39.544580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:39.581519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b9670e89-9d0c-4145-b793-174dbc71e43c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055427 Jun 20 06:18:39.582432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 532/877] 10.222.0.39 () {60 vars in 1342 bytes} [Mon Jun 20 06:18:39 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:18:40.349569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:40.350220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:40.357548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.357992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.358802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.359240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.373529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 HTTP/1.1 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:18:40.375220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:18:40.376820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '0d58d309-e139-4ba1-bfbb-3eb6374de542'} Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:40.377724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:18:40.379153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:40.380472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:40.380472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fffab505-4ffb-43e8-ba20-15019267fc1d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 404 len: 111 microversion: 2.1 time: 0.030960 Jun 20 06:18:40.380472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 533/878] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:40 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:18:40.390606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-67e3dc41-f012-426f-974a-a563d9352a1b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '.version_select at 0x7f21f1e265e0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:40.415043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-67e3dc41-f012-426f-974a-a563d9352a1b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-211024648" status: 202 len: 0 microversion: 2.1 time: 0.028216 Jun 20 06:18:40.415513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 534/879] 10.222.0.39 () {58 vars in 1217 bytes} [Mon Jun 20 06:18:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-211024648 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:18:40.593979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:40.594908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:40.608868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.609414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.611152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.612079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.649790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fb930023-eecb-4bb1-9abf-0e01a01fc249 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.059366 Jun 20 06:18:40.655696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 535/880] 10.222.0.39 () {60 vars in 1342 bytes} [Mon Jun 20 06:18:40 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:40.714975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:40.715483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:40.721540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.722000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.722795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.723214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.750437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:40.832988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dab1d7c9-3757-43a9-aa73-7c02eb351ea9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 204 len: 0 microversion: 2.20 time: 0.121716 Jun 20 06:18:40.834016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 536/881] 10.222.0.39 () {60 vars in 1279 bytes} [Mon Jun 20 06:18:40 2022] DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 06:18:40.844257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:40.845000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:40.850959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.851418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:40.852187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:40.853326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:41.037082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:41.045754 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:41.047329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:41.048807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-462bdbf6-9869-4a89-b176-763cd37451a7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.208734 Jun 20 06:18:41.049585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 537/882] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:40 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:41.215877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:41.216412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:41.227937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:41.228404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:41.229336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:41.229795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:41.310990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lazy-loading 'services' on Instance uuid c0338365-19aa-44e3-bf8b-fa704eb7ce10 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:41.314356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:41.389671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-02f693dd-9719-4326-8cb2-d007f9e026fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments/055c4560-044b-4a5c-9f94-e875f159af44" status: 202 len: 0 microversion: 2.1 time: 0.178099 Jun 20 06:18:41.393325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 538/883] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:18:41 2022] DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments/055c4560-044b-4a5c-9f94-e875f159af44 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:18:41.399999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:41.401226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:41.407878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:41.408331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:41.409123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:41.409561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:41.438177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ff40d1f0-5204-4385-a73e-6f571e6d5170 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Jun 20 06:18:41.438721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 539/884] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:18:41 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:42.067555 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:42.068201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:42.074848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:42.075304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:42.076080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:42.076525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:42.205568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:42.213396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:42.214894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:42.216050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-735bc0b1-2b42-49f9-a7d3-a9124755cf61 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.152465 Jun 20 06:18:42.216615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 540/885] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:42 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:42.449905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:42.450854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:42.457836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:42.458001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:42.458786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:42.459231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:42.488845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3d5b4c9e-0afc-408c-9f78-279a9e0ccc93 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042861 Jun 20 06:18:42.489403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 541/886] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:18:42 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:43.233977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:43.234588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:43.240781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:43.241240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:43.242003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:43.242447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:43.484636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:43.495353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:43.496110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:43.497351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2bf9da8e-b886-4948-8528-b69b928db7e3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1722 microversion: 2.20 time: 0.267599 Jun 20 06:18:43.507582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 542/887] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:43 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1722 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:43.507582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:43.507582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:43.510688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:43.511243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:43.512233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:43.512674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:43.543137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9dc597ff-2bc5-47b7-b3bd-0791557fffd0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044191 Jun 20 06:18:43.543706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 543/888] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:18:43 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:44.116580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-b55f5e7c-4bfd-497f-9955-303768b9a039 req-74d2127e-9ed9-4e7a-8c65-69ea1b2de452 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a94bb25-2c14-43f3-91a3-1f75da735166", "name": "network-vif-deleted", "tag": "f95b5f57-bc74-43ad-af6e-3d7c11e8493f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:44.127499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b55f5e7c-4bfd-497f-9955-303768b9a039 req-74d2127e-9ed9-4e7a-8c65-69ea1b2de452 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.127942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b55f5e7c-4bfd-497f-9955-303768b9a039 req-74d2127e-9ed9-4e7a-8c65-69ea1b2de452 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.139668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-b55f5e7c-4bfd-497f-9955-303768b9a039 req-74d2127e-9ed9-4e7a-8c65-69ea1b2de452 service nova] Creating event network-vif-deleted:f95b5f57-bc74-43ad-af6e-3d7c11e8493f for instance 7a94bb25-2c14-43f3-91a3-1f75da735166 on hv-cinder-80403 Jun 20 06:18:44.144632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-b55f5e7c-4bfd-497f-9955-303768b9a039 req-74d2127e-9ed9-4e7a-8c65-69ea1b2de452 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032066 Jun 20 06:18:44.145480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 544/889] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:44.516655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:44.517305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:44.523407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.523861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.525824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.526273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.559287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.559739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.560191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lazy-loading 'fault' on Instance uuid 7a94bb25-2c14-43f3-91a3-1f75da735166 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:44.605805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:44.614889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:44.616435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:44.617638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-add291f6-bbc5-42ec-a825-547fa38fa01a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 200 len: 1370 microversion: 2.20 time: 0.105849 Jun 20 06:18:44.618195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 545/890] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:44 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 1370 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:44.622835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:44.623766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:44.630188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.630656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.631443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.631975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.665819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8f4952fe-1299-4150-a09b-b9009f7d8dde tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046302 Jun 20 06:18:44.666507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 546/891] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:18:44 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:18:44.732906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:44.733399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:44.739534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.740001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.740864 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.741303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.772502 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:18:44.853978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-306f8ec6-88ca-4207-9436-d95a1f50e2aa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 204 len: 0 microversion: 2.1 time: 0.125008 Jun 20 06:18:44.854751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 547/892] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:18:44 2022] DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:18:44.863766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:44.864479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:44.871295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.871758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:44.872547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:44.873068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:45.008204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:45.015826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2a32d670-8584-4b83-9b9b-f91e57e33ec9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1679 microversion: 2.1 time: 0.156132 Jun 20 06:18:45.016397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 548/893] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:44 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:45.635607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:45.636282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:45.642748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:45.643196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:45.643956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:45.644394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:45.657625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 HTTP/1.1 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:18:45.659299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:18:45.660923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '7a94bb25-2c14-43f3-91a3-1f75da735166'} Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:45.661846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:18:45.663267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:45.665168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:45.665168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-df57d6a7-48de-4c58-b1cd-6b13932506f4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 404 len: 111 microversion: 2.20 time: 0.028947 Jun 20 06:18:45.665168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 549/894] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:45 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:18:45.669696 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3eef2a11-2f3f-4d5d-a281-fabd1f88f69e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '.version_select at 0x7f21ed0369d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:45.687644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3eef2a11-2f3f-4d5d-a281-fabd1f88f69e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-973815044" status: 204 len: 0 microversion: 2.20 time: 0.021485 Jun 20 06:18:45.688190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 550/895] 10.222.0.39 () {60 vars in 1258 bytes} [Mon Jun 20 06:18:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-973815044 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 06:18:46.033405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:46.034027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:46.041169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:46.041643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:46.042438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:46.042882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:46.306347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:46.323407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-397578f0-2ce5-44f8-b045-813cadb7a84e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1679 microversion: 2.1 time: 0.293761 Jun 20 06:18:46.328849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 551/896] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:46 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1679 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:46.345454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2e09f87a-5a93-47af-be05-5ddb32e18db7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: .version_select at 0x7f21ed036c10>, body: {"keypair": {"name": "tempest-keypair-1565036112", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOmQaUkZjCVXRt2yG1ZfrvqDr0wN1EbrAkRiBJlFq6ebPcS5lAcli2R518j53aSDHaP35hdBuMDSAp5xGquWfEvE1DoIEtnjcGq1pjSGVY49SFjf2ZaZLWiP2C5PZLyr/g=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:46.361205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-2e09f87a-5a93-47af-be05-5ddb32e18db7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:46.365084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-2e09f87a-5a93-47af-be05-5ddb32e18db7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for user 498822fcffaf4cc79532c487418cb11c and project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:46.381191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:46.391061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2e09f87a-5a93-47af-be05-5ddb32e18db7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.049767 Jun 20 06:18:46.391670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 552/897] 10.222.0.39 () {62 vars in 1199 bytes} [Mon Jun 20 06:18:46 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 51 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 20 06:18:46.787242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-243016d2-3c86-4789-a688-098260e611d8 req-47aa21c0-ddec-4c97-afaa-bcc96811e66f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0338365-19aa-44e3-bf8b-fa704eb7ce10", "name": "network-vif-deleted", "tag": "65c2764e-d3ea-45db-917a-f5e152011a84"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:46.798954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-243016d2-3c86-4789-a688-098260e611d8 req-47aa21c0-ddec-4c97-afaa-bcc96811e66f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:46.799412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-243016d2-3c86-4789-a688-098260e611d8 req-47aa21c0-ddec-4c97-afaa-bcc96811e66f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:46.811343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-243016d2-3c86-4789-a688-098260e611d8 req-47aa21c0-ddec-4c97-afaa-bcc96811e66f service nova] Creating event network-vif-deleted:65c2764e-d3ea-45db-917a-f5e152011a84 for instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 on hv-cinder-80403 Jun 20 06:18:46.816862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-243016d2-3c86-4789-a688-098260e611d8 req-47aa21c0-ddec-4c97-afaa-bcc96811e66f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034408 Jun 20 06:18:46.818383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 553/898] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:47.345946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:47.346764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:47.358131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:47.358945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:47.360090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:47.360759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:47.398362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:47.400044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:47.400746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lazy-loading 'fault' on Instance uuid c0338365-19aa-44e3-bf8b-fa704eb7ce10 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:18:47.465379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:47.473757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-92cea465-4175-4bef-a333-ce410497bb13 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 200 len: 1330 microversion: 2.1 time: 0.131989 Jun 20 06:18:47.474433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 554/899] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:47 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 1330 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:47.855326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-178880713", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b8541f83-01e2-4596-9c3d-ab5f0b6a08b8"}], "security_groups": [{"name": "tempest-securitygroup--1224539221"}], "key_name": "tempest-keypair-1565036112", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:47.967295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] validate_networks() for [('b8541f83-01e2-4596-9c3d-ab5f0b6a08b8', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:18:48.596934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:18:48.597530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:18:48.598032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:18:48.598645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:18:48.599069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:18:48.608127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:48.608582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:48.609420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:48.609865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:48.626521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:48.630488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Getting quotas for user 498822fcffaf4cc79532c487418cb11c and project 0b2cb11b20af48f8b0e9f0a4cf1b9406. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:48.642061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:18:48.644306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:18:48.696240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6f9150fc-22f6-41b9-957d-cee3991f1610 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.844936 Jun 20 06:18:48.696926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 555/900] 10.222.0.39 () {62 vars in 1187 bytes} [Mon Jun 20 06:18:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 847 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 20 06:18:48.704722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:48.704722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:48.708560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:48.709112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:48.710013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:48.710641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:48.726501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 HTTP/1.1 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:18:48.728598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:18:48.730164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'c0338365-19aa-44e3-bf8b-fa704eb7ce10'} Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:18:48.730959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:18:48.732441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:18:48.733578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:18:48.733578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8eeb34b7-2f34-4549-b777-045b49e8a149 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 404 len: 111 microversion: 2.1 time: 0.032266 Jun 20 06:18:48.733578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 556/901] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:48 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:18:48.735943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:48.736562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:48.789173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:48.796610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:48.798222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:48.799336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f4845c70-5583-441d-aa3a-10304068ffc3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1281 microversion: 2.20 time: 0.067126 Jun 20 06:18:48.800080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 557/902] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:48 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1281 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:48.804576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8ff7bc1c-735c-46e2-80eb-37b93decc0b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '.version_select at 0x7f21ed0649d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:48.826090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8ff7bc1c-735c-46e2-80eb-37b93decc0b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762718235" status: 202 len: 0 microversion: 2.1 time: 0.024813 Jun 20 06:18:48.826682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 558/903] 10.222.0.39 () {58 vars in 1217 bytes} [Mon Jun 20 06:18:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762718235 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:18:49.499749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ea4c37be-bca2-49e4-bbfd-8cfca7d1bd8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: .version_select at 0x7f21f1f0d430>, body: {"keypair": {"name": "tempest-keypair-753984848", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1u7SpAm1amkxKartZaqSM34h3b6HPCgXccJOJGoyLYrFjj9P4o45E4W1aZSMEidRZn+uEfXeE2sIsbqb7BzhzkJtV1lM7/PwFM0DDcjoa5Xzo+NSYyvWIzDqAjfzA+UA=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:49.513261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-ea4c37be-bca2-49e4-bbfd-8cfca7d1bd8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:49.517101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-ea4c37be-bca2-49e4-bbfd-8cfca7d1bd8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:49.538704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ea4c37be-bca2-49e4-bbfd-8cfca7d1bd8f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.043618 Jun 20 06:18:49.539331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 559/904] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:18:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:49.819325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:49.819957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:49.826909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:49.827371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:49.828376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:49.828869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:49.919487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:49.937475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:49.939330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:49.940542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-974fa034-46ef-4ef7-a760-19d8e6256c69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1351 microversion: 2.20 time: 0.126490 Jun 20 06:18:49.941135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 560/905] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:49 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1351 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:50.895683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1556087906", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e482afaf-8e11-49aa-a25e-27526ac7158f"}], "security_groups": [{"name": "tempest-securitygroup--1952384062"}], "key_name": "tempest-keypair-753984848", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:51.046610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] validate_networks() for [('e482afaf-8e11-49aa-a25e-27526ac7158f', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:18:51.650605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:18:51.651115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:18:51.651700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:18:51.652376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:18:51.652854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:18:51.661438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:51.661895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:51.662805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:51.663249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:51.671247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:51.685359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:18:51.690834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:18:51.710017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:18:51.713739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:18:51.769013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f683cef0-68ab-427a-96f3-bc6757e1a5d9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.877597 Jun 20 06:18:51.770090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 561/906] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:18:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:18:51.775716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:51.776412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:51.782937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:51.783503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:51.784363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:51.784907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:52.046488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:52.055424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:52.057197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:52.058558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5126aa5e-9b6f-49ac-a267-0c9a0ec5ffdd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.287256 Jun 20 06:18:52.059683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 562/907] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:51 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:52.064364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f9729fad-4df5-4861-91b2-28872b35fac4 req-b7b7b72e-ec5e-4ab3-bbc5-a4a570ec91fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:52.073501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f9729fad-4df5-4861-91b2-28872b35fac4 req-b7b7b72e-ec5e-4ab3-bbc5-a4a570ec91fc service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:52.074054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f9729fad-4df5-4861-91b2-28872b35fac4 req-b7b7b72e-ec5e-4ab3-bbc5-a4a570ec91fc service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:52.086103 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f9729fad-4df5-4861-91b2-28872b35fac4 req-b7b7b72e-ec5e-4ab3-bbc5-a4a570ec91fc service nova] Creating event network-changed:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:18:52.092513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f9729fad-4df5-4861-91b2-28872b35fac4 req-b7b7b72e-ec5e-4ab3-bbc5-a4a570ec91fc service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030932 Jun 20 06:18:52.093208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 563/908] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:18:52.098961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fce5976a-ddf3-481b-b929-cd5383899cdc tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:52.099898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fce5976a-ddf3-481b-b929-cd5383899cdc tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:52.166791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fce5976a-ddf3-481b-b929-cd5383899cdc tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:52.173517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fce5976a-ddf3-481b-b929-cd5383899cdc tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1241 microversion: 2.1 time: 0.079098 Jun 20 06:18:52.174086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 564/909] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:52 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1241 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:53.078121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:53.078744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:53.085988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:53.087124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:53.087902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:53.088351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:53.218519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:53.226328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:53.228414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:53.229546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-06ec35a0-b472-4ea7-a071-8a7ab6ba4d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.155766 Jun 20 06:18:53.230099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 565/910] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:53 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:53.234637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:53.235240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:53.240933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:53.241403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:53.242143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:53.242578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:53.302647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:53.310249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2734f201-3ba3-470c-bb64-e0a76850b48f tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1293 microversion: 2.1 time: 0.079215 Jun 20 06:18:53.310816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 566/911] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:53 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1293 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:54.247200 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:54.247860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:54.254270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:54.254730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:54.255501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:54.255944 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:54.387391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:54.395339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:54.396876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:54.397984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4a4a55ca-e567-4453-88d6-e113e9c9508c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.155528 Jun 20 06:18:54.398538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 567/912] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:54 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:54.403364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:54.403967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:54.410456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:54.410981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:54.411760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:54.412240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:54.476604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:54.486181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c74dec49-59ee-4e07-b668-6a4604c18926 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1293 microversion: 2.1 time: 0.086474 Jun 20 06:18:54.486943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 568/913] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:54 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1293 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:55.418113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:55.418828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:55.425319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:55.425829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:55.426552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:55.427005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:55.673061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:55.682610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:55.684138 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:55.685521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6dbe6274-b05a-4b35-89ba-de30883ed6fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.271357 Jun 20 06:18:55.686087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 569/914] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:55 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:55.691042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:55.691658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:55.699456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:55.699918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:55.700953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:55.701577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:55.788186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:55.795748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-782cfb07-4b48-46e5-9267-1e5553c7a2df tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1299 microversion: 2.1 time: 0.108478 Jun 20 06:18:55.796336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 570/915] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:55 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1299 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:56.674321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f99dd3a4-63b0-4bec-a254-afdcac8b47e7 req-638e815b-5701-414a-9c5f-579021eddca1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66b01e5-b7b8-4259-8fc4-88aafb3a66b8", "tag": "a17f2293-5544-4c88-ac14-ab8970fdf4ae"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:56.683334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f99dd3a4-63b0-4bec-a254-afdcac8b47e7 req-638e815b-5701-414a-9c5f-579021eddca1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:56.684246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f99dd3a4-63b0-4bec-a254-afdcac8b47e7 req-638e815b-5701-414a-9c5f-579021eddca1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:56.707295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f99dd3a4-63b0-4bec-a254-afdcac8b47e7 req-638e815b-5701-414a-9c5f-579021eddca1 service nova] Creating event network-changed:a17f2293-5544-4c88-ac14-ab8970fdf4ae for instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 on hv-cinder-80403 Jun 20 06:18:56.712913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f99dd3a4-63b0-4bec-a254-afdcac8b47e7 req-638e815b-5701-414a-9c5f-579021eddca1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042406 Jun 20 06:18:56.713627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 571/916] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:56.719073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:56.719773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:56.726191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:56.726698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:56.727476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:56.727912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:57.207453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:57.215803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:57.217383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:57.218505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-227eea0c-1fc4-4f84-ac67-a9dc686818bf tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.503731 Jun 20 06:18:57.219075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 572/917] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:56 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:18:57.223453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:57.224067 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:57.230396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:57.230869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:57.231918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:57.232360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:57.446302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:57.454046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-72ec48f5-09c5-4703-8659-fc979fa929ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.233941 Jun 20 06:18:57.454908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 573/918] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:57 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:18:57.632061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-55dd5192-4929-47ff-aa27-ddd90a7bf6af req-ec76886e-6b8a-492e-8645-92fa5d52bec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "name": "network-vif-plugged", "status": "completed", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:18:57.640961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-55dd5192-4929-47ff-aa27-ddd90a7bf6af req-ec76886e-6b8a-492e-8645-92fa5d52bec2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:57.641449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-55dd5192-4929-47ff-aa27-ddd90a7bf6af req-ec76886e-6b8a-492e-8645-92fa5d52bec2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:57.653562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-55dd5192-4929-47ff-aa27-ddd90a7bf6af req-ec76886e-6b8a-492e-8645-92fa5d52bec2 service nova] Creating event network-vif-plugged:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:18:57.658427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-55dd5192-4929-47ff-aa27-ddd90a7bf6af req-ec76886e-6b8a-492e-8645-92fa5d52bec2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030059 Jun 20 06:18:57.659027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 574/919] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:18:58.237638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:58.238374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:58.245306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:58.245758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:58.246515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:58.246948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:58.375664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:58.383729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:58.385277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:58.386385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-437c7cc0-0765-42ad-a441-13fd3d2c7561 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.153532 Jun 20 06:18:58.386937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 575/920] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:58 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:58.471009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:58.471628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:58.478657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:58.479106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:58.479872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:58.480312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:58.605125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:58.612912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-efc6d8f4-a91e-4b11-963e-0ba607331b97 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.145701 Jun 20 06:18:58.613490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 576/921] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:58 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:18:59.404636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:59.405293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:59.407726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:INSERT=8,nova_api:SELECT=91,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:18:59.413428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:59.413891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:59.415389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:59.415834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:59.551050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:59.559161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:59.560684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:59.562415 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-615a32bf-b54f-4306-91b0-d0e11db26e18 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.161809 Jun 20 06:18:59.562984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 577/922] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:18:59 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:18:59.628729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:18:59.629352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:18:59.636048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:59.636499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:59.637292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:18:59.637724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:18:59.766940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:18:59.775097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-938bf545-9cfc-427e-a520-0ef02900b9e8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.150223 Jun 20 06:18:59.775664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 578/923] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:18:59 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:00.580443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:00.581137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:00.587745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:00.588188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:00.588988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:00.589429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:00.717456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:00.725183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:00.727309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:00.728411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aa62d562-3cd9-4f55-83e1-bd830cdf2801 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.151868 Jun 20 06:19:00.729019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 579/924] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:00 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:19:00.791703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:00.792397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:00.798318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:00.798769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:00.799520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:00.799954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:01.022227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:01.030386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6bea0e79-2169-4286-84d5-eb3c6902d917 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.242865 Jun 20 06:19:01.037176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 580/925] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:00 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:01.746792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:01.747617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:01.750981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:01.755456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:01.755907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:01.756677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:01.757133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:01.775011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:01.915806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:01.924152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:01.925699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:01.926828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-24a68621-9cbc-4397-8ed1-e4453798ec47 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1407 microversion: 2.20 time: 0.185331 Jun 20 06:19:01.927385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 581/926] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:01 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:19:01.932831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-c95e5f3e-482d-40ca-bfd6-0b18f3690c72 req-0671811c-6519-445c-b25d-68e8452913bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66b01e5-b7b8-4259-8fc4-88aafb3a66b8", "name": "network-vif-plugged", "status": "completed", "tag": "a17f2293-5544-4c88-ac14-ab8970fdf4ae"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:01.941065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c95e5f3e-482d-40ca-bfd6-0b18f3690c72 req-0671811c-6519-445c-b25d-68e8452913bb service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:01.941515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c95e5f3e-482d-40ca-bfd6-0b18f3690c72 req-0671811c-6519-445c-b25d-68e8452913bb service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:01.953182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-c95e5f3e-482d-40ca-bfd6-0b18f3690c72 req-0671811c-6519-445c-b25d-68e8452913bb service nova] Creating event network-vif-plugged:a17f2293-5544-4c88-ac14-ab8970fdf4ae for instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 on hv-cinder-80403 Jun 20 06:19:01.957963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-c95e5f3e-482d-40ca-bfd6-0b18f3690c72 req-0671811c-6519-445c-b25d-68e8452913bb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029484 Jun 20 06:19:01.958536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 582/927] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:02.048765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:02.049477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:02.056367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:02.056866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:02.057646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:02.058096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:02.171675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=24 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:02.195040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:02.202795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b0472381-9884-4d6e-9220-6e36cc52f8fa tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.158358 Jun 20 06:19:02.203371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 583/928] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:02 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:02.948428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:02.949120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:02.955612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:02.956096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:02.956892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:02.957334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.083955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:03.092387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:03.094878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:03.096052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7a7ba40b-1b76-470b-bfc2-df52a46baff2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1600 microversion: 2.20 time: 0.152282 Jun 20 06:19:03.096614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 584/929] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:19:02 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:19:03.119267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:03.119937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:03.126013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.126466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.127222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.127657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.204904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b9df1df8-778c-4cf3-a680-5cb47e4d4ac6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.090273 Jun 20 06:19:03.205566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 585/930] 10.222.0.39 () {60 vars in 1315 bytes} [Mon Jun 20 06:19:03 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:19:03.218809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:03.219418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:03.225441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.225894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.226664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:03.227100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:03.359498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:03.366919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-42b81ff8-d277-486d-aff3-91ea9eef6cd7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.151708 Jun 20 06:19:03.367503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 586/931] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:03 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:04.412376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-0dbb01bb-e048-47dc-9267-ad31837f3fa4 req-bb27ae53-e5af-474d-bc8c-361c52c85fc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:04.422385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0dbb01bb-e048-47dc-9267-ad31837f3fa4 req-bb27ae53-e5af-474d-bc8c-361c52c85fc0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:04.422829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0dbb01bb-e048-47dc-9267-ad31837f3fa4 req-bb27ae53-e5af-474d-bc8c-361c52c85fc0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:04.438319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-0dbb01bb-e048-47dc-9267-ad31837f3fa4 req-bb27ae53-e5af-474d-bc8c-361c52c85fc0 service nova] Creating event network-changed:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:19:04.454129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-0dbb01bb-e048-47dc-9267-ad31837f3fa4 req-bb27ae53-e5af-474d-bc8c-361c52c85fc0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119060 Jun 20 06:19:04.455435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 587/932] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:04.463692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:04.464592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:04.471912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:04.472517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:04.473337 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:04.473774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:04.610526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:04.618002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-37e62027-e523-4ce0-93e9-cfe413d565f9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1367 microversion: 2.1 time: 0.160735 Jun 20 06:19:04.619104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 588/933] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:04 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:05.636298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:05.636989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:05.643340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:05.643790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:05.644549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:05.645017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:05.776772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:05.785494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-13e32dc8-3828-46ad-9162-15c10773e0a4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1556 microversion: 2.1 time: 0.153898 Jun 20 06:19:05.786086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 589/934] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:05 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:05.802355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:05.802850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:05.809282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:05.809737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:05.810494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:05.810932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:05.887688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7a86f7d0-90b0-487a-af44-242b765aeba6 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089112 Jun 20 06:19:05.888303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 590/935] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:19:05 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:06.835358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-6cd78a31-99e9-482e-a151-91d5598fab8c req-678bfc2c-315a-4949-8fa3-6a20589c87e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d66b01e5-b7b8-4259-8fc4-88aafb3a66b8", "tag": "a17f2293-5544-4c88-ac14-ab8970fdf4ae"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:06.844058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6cd78a31-99e9-482e-a151-91d5598fab8c req-678bfc2c-315a-4949-8fa3-6a20589c87e3 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:06.844506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6cd78a31-99e9-482e-a151-91d5598fab8c req-678bfc2c-315a-4949-8fa3-6a20589c87e3 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:06.856516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-6cd78a31-99e9-482e-a151-91d5598fab8c req-678bfc2c-315a-4949-8fa3-6a20589c87e3 service nova] Creating event network-changed:a17f2293-5544-4c88-ac14-ab8970fdf4ae for instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 on hv-cinder-80403 Jun 20 06:19:06.861401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-6cd78a31-99e9-482e-a151-91d5598fab8c req-678bfc2c-315a-4949-8fa3-6a20589c87e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030275 Jun 20 06:19:06.862177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 591/936] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:12.801423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:12.802055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:12.809023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.809480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.810249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.810687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.889666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'services' on Instance uuid 8b76e034-2305-4617-b97c-f80419ff97c7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:12.959104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a686a6c-62e8-4a16-939e-c7d7d9bd4466 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments/ea98b0a2-2222-48c4-bd1e-d43927bedb4b" status: 202 len: 0 microversion: 2.1 time: 0.161780 Jun 20 06:19:12.959758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 592/937] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:19:12 2022] DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments/ea98b0a2-2222-48c4-bd1e-d43927bedb4b => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:19:12.969378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:12.970446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:12.976571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.977069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:12.978504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:12.978955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:13.009087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-838747c7-74c1-482f-9e6d-95506d725058 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043551 Jun 20 06:19:13.009566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 593/938] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:12 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:14.020255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:14.021210 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:14.027900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.028351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.029143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.029578 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.060245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4bd3bf0f-67b1-43fd-9e47-01fc4f19cb3b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043800 Jun 20 06:19:14.060828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 594/939] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:14 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:19:14.134499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:14.135115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:14.141325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.141728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.142529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.142972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.168520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:14.241651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f082210f-8ec9-49d6-a855-f64880e4c4ef tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 204 len: 0 microversion: 2.1 time: 0.110779 Jun 20 06:19:14.242263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 595/940] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:14 2022] DELETE /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:19:14.254599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:14.255348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:14.261458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.261910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.262671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:14.263111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:14.403325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:14.410977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a798e7d6-bf5d-4b31-b96f-0535080b1448 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1690 microversion: 2.1 time: 0.160425 Jun 20 06:19:14.411538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 596/941] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:14 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1690 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:15.428756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:15.429380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:15.436438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:15.436930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:15.437691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:15.438129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:15.568826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:15.576378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a7b8265-82c3-4643-a0c6-4db56c293909 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1690 microversion: 2.1 time: 0.151613 Jun 20 06:19:15.576976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 597/942] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:15 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1690 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:16.593245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:16.593838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:16.600443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:16.601010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:16.601768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:16.602204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:16.617015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:16.734340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:16.741701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-05d2d6aa-5191-4eb2-b540-24e2bc284169 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1690 microversion: 2.1 time: 0.152319 Jun 20 06:19:16.742273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 598/943] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:16 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:17.759246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:17.760410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:17.766877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:17.767331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:17.768086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:17.768521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:17.906310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:17.914028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2f3a675c-3aaf-4d2c-8d9a-4d9a317a3cd7 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1690 microversion: 2.1 time: 0.158636 Jun 20 06:19:17.914615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 599/944] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:17 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:18.930252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:18.930914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:18.937780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:18.938242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:18.939023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:18.939466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:19.437852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:19.445465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-685b444a-a50e-4742-8714-b650ed466f98 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1690 microversion: 2.1 time: 0.519138 Jun 20 06:19:19.446268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 600/945] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:18 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1690 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:19.956583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-e3744ad0-e3eb-45e2-a50e-ec72bf97029b req-8a9fdf32-1af8-432d-a5b0-66370a849d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b76e034-2305-4617-b97c-f80419ff97c7", "name": "network-vif-deleted", "tag": "9a0d630b-6c07-425d-84b2-09e99375c337"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:19.968226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e3744ad0-e3eb-45e2-a50e-ec72bf97029b req-8a9fdf32-1af8-432d-a5b0-66370a849d0b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:19.969139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e3744ad0-e3eb-45e2-a50e-ec72bf97029b req-8a9fdf32-1af8-432d-a5b0-66370a849d0b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:19.988511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-e3744ad0-e3eb-45e2-a50e-ec72bf97029b req-8a9fdf32-1af8-432d-a5b0-66370a849d0b service nova] Creating event network-vif-deleted:9a0d630b-6c07-425d-84b2-09e99375c337 for instance 8b76e034-2305-4617-b97c-f80419ff97c7 on hv-cinder-80403 Jun 20 06:19:19.995434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-e3744ad0-e3eb-45e2-a50e-ec72bf97029b req-8a9fdf32-1af8-432d-a5b0-66370a849d0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041209 Jun 20 06:19:19.996059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 601/946] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:20.464788 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:20.465796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:20.472378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:20.473741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:20.473741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:20.475051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:20.507949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:20.508566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:20.509032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'fault' on Instance uuid 8b76e034-2305-4617-b97c-f80419ff97c7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:20.563086 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:20.572551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1e9aa143-80b5-4d8e-a210-ebe6cbfb7cdd tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 200 len: 1335 microversion: 2.1 time: 0.112991 Jun 20 06:19:20.573429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 602/947] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:20 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 1335 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:21.590659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:21.591358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: 8b76e034-2305-4617-b97c-f80419ff97c7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:21.597662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:21.598111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:21.598869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:21.599308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:21.612478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] HTTP exception thrown: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Request method failure captured: Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 HTTP/1.1 Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-J8yVqXlvOU9pICRZquWgc6kRnsz6Lcq0D6hxi4Vrduz-utYb-xv1OmgyPq5UmHKsPSHOTR3x-KoqzIoSAh3iEjRh10PIWIz6ednYSLb-_geiar9iS2pa1PxXPbHeTvRJq4oGfGcJQayLtEH2kL4L07-iejUc1D8xrf6uPNHakhLA Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:19:21.614178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}] Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: e1516d2903414b7caf082c32dcdac3eb Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. Jun 20 06:19:21.615773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '8b76e034-2305-4617-b97c-f80419ff97c7'} Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:21.616691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. Jun 20 06:19:21.618226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:21.619568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Returning 404 to user: Instance 8b76e034-2305-4617-b97c-f80419ff97c7 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:21.619568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-040368fe-2722-49b4-8779-fe44ca3fe7ca tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7" status: 404 len: 111 microversion: 2.1 time: 0.029710 Jun 20 06:19:21.619568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 603/948] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:21 2022] GET /compute/v2.1/servers/8b76e034-2305-4617-b97c-f80419ff97c7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:19:21.623728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fd1ca87e-3188-4640-aa5c-1ce42664cf27 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '.version_select at 0x7f21edb3f040>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:21.640819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fd1ca87e-3188-4640-aa5c-1ce42664cf27 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454532927" status: 202 len: 0 microversion: 2.1 time: 0.020457 Jun 20 06:19:21.641366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 604/949] 10.222.0.39 () {58 vars in 1220 bytes} [Mon Jun 20 06:19:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1454532927 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:19:24.458593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:24.459097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:24.465527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.465980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.466796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.467236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.494640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:24.569534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-61b0d419-4d17-4e73-9c8a-1f895dd9fd60 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 204 len: 0 microversion: 2.1 time: 0.116504 Jun 20 06:19:24.570189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 605/950] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:24 2022] DELETE /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:19:24.575711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:24.576296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:24.582449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.582909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.583672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.584114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.610082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:24.684152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4744ff6e-ca6d-48df-bf3d-5bdb860c4c2e tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 204 len: 0 microversion: 2.1 time: 0.112715 Jun 20 06:19:24.684743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 606/951] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:24 2022] DELETE /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:19:24.689701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:24.690399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:24.695823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.696282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.697426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.697876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.839602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:24.847283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c568ca32-36e8-41cf-8d8d-80e8dd3577d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1579 microversion: 2.1 time: 0.161427 Jun 20 06:19:24.847844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 607/952] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:24 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1579 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:24.852099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:24.852713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:24.859168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.859615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.860366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:24.860828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:24.987636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:24.995487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6e95b40e-b4a3-4a30-a15f-8f211e92658b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1508 microversion: 2.1 time: 0.146703 Jun 20 06:19:24.996039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 608/953] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:24 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:25.865661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:25.866313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:25.873367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:25.873814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:25.874703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:25.875050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:26.001904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:26.010308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2cbe9c60-3a8f-4680-97b2-f84a877b0b9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1579 microversion: 2.1 time: 0.148387 Jun 20 06:19:26.010921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 609/954] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:25 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1579 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:26.015399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:26.016002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:26.021807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:26.022263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:26.023032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:26.023468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:26.158828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:26.167038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8ec259a-b84c-4400-9984-68ff39d5b950 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1508 microversion: 2.1 time: 0.155155 Jun 20 06:19:26.167593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 610/955] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:26 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:27.028189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:27.028886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:27.034912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.035366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.036267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.036571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.168552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:27.176042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-53940c81-1b86-449e-8145-031a93a30ba6 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1579 microversion: 2.1 time: 0.152654 Jun 20 06:19:27.176607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 611/956] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:27 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1579 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:27.183621 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:27.184232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:27.189965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.190421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.191189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:27.191633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:27.322739 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:27.330349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ca9da853-395b-4903-800d-672766f1b7f8 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1508 microversion: 2.1 time: 0.150360 Jun 20 06:19:27.330911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 612/957] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:27 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:28.194425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:28.195076 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:28.201652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.202113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.202896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.203344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.456762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:28.459066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:28.468604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2feb3cd9-a0e1-4ab2-b648-9c500a451223 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1579 microversion: 2.1 time: 0.278095 Jun 20 06:19:28.474309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 613/958] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:28 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1579 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:28.474731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:28.475980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:28.485347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.485960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.486937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.487554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.528755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.529233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.530050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'fault' on Instance uuid a56a8cd9-74e7-4fa3-8423-12112a7321b7 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:28.606562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:28.615178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b4906762-0b50-48cf-b4a6-4f3c7e789c3d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 200 len: 1312 microversion: 2.1 time: 0.144909 Jun 20 06:19:28.615766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 614/959] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:28 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 1312 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:28.620371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-5584dfe0-c298-44f9-b656-f3fcacc2633a req-a8c4a1f5-80f5-4814-b81e-b6893668cf96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a56a8cd9-74e7-4fa3-8423-12112a7321b7", "name": "network-vif-deleted", "tag": "335f3da0-2be8-4179-92bc-ba0c3c29d492"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:28.623817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:28.629658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5584dfe0-c298-44f9-b656-f3fcacc2633a req-a8c4a1f5-80f5-4814-b81e-b6893668cf96 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:28.630106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5584dfe0-c298-44f9-b656-f3fcacc2633a req-a8c4a1f5-80f5-4814-b81e-b6893668cf96 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:28.644860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-5584dfe0-c298-44f9-b656-f3fcacc2633a req-a8c4a1f5-80f5-4814-b81e-b6893668cf96 service nova] Creating event network-vif-deleted:335f3da0-2be8-4179-92bc-ba0c3c29d492 for instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 on hv-cinder-80403 Jun 20 06:19:28.650875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-5584dfe0-c298-44f9-b656-f3fcacc2633a req-a8c4a1f5-80f5-4814-b81e-b6893668cf96 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032966 Jun 20 06:19:28.651255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 615/960] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:29.487588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:29.488616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:29.496385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.497050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.497927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.498437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.535094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.535805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.536426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lazy-loading 'fault' on Instance uuid 6135799a-c691-4c98-af12-4cce0ab2da1a {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:29.586949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:29.596462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4f414838-cf1a-4405-bf4b-fcca0e6df1fa tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 200 len: 1231 microversion: 2.1 time: 0.113650 Jun 20 06:19:29.597550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 616/961] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:29 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:29.632517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:29.633165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: a56a8cd9-74e7-4fa3-8423-12112a7321b7] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:29.640133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.640586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.641401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.641984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.656900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] HTTP exception thrown: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Request method failure captured: Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 HTTP/1.1 Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-J8yVqXlvOU9pICRZquWgc6kRnsz6Lcq0D6hxi4Vrduz-utYb-xv1OmgyPq5UmHKsPSHOTR3x-KoqzIoSAh3iEjRh10PIWIz6ednYSLb-_geiar9iS2pa1PxXPbHeTvRJq4oGfGcJQayLtEH2kL4L07-iejUc1D8xrf6uPNHakhLA Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:19:29.658556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}] Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: e1516d2903414b7caf082c32dcdac3eb Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. Jun 20 06:19:29.660189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'a56a8cd9-74e7-4fa3-8423-12112a7321b7'} Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:29.661148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. Jun 20 06:19:29.662921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:29.664085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Returning 404 to user: Instance a56a8cd9-74e7-4fa3-8423-12112a7321b7 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:29.664085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ae6de720-c087-497b-8f38-4302cfcbfb2d tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7" status: 404 len: 111 microversion: 2.1 time: 0.031681 Jun 20 06:19:29.664085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 617/962] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:29 2022] GET /compute/v2.1/servers/a56a8cd9-74e7-4fa3-8423-12112a7321b7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:19:29.669585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:29.670084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:29.675995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.676450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.677274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.677713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.705833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:29.797533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-14d6cd66-698c-4a9c-81b5-f826193fed7b tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 204 len: 0 microversion: 2.1 time: 0.131400 Jun 20 06:19:29.800791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 618/963] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:29 2022] DELETE /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:19:29.807137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:29.808182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:29.816437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.817480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.818716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:29.819530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:29.956492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:29.965809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-806f91f2-e262-4d62-8c7f-5a354745af65 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1521 microversion: 2.1 time: 0.163178 Jun 20 06:19:29.967187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 619/964] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:29 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:30.614099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:30.614744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:30.622146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:30.622599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:30.623368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:30.623805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:30.637317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] HTTP exception thrown: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Request method failure captured: Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a HTTP/1.1 Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBORLUSBuUnh4-Y_RiMgSbHClzypRYakUqoBLPjpQfELm8M_auCU4PdlUi_7HZmMJdfDY2vO744NforUGcNzCO7KjfigzHQpDuQjyWOuMhpX0wCnAYUph1M49oU8Qbt8fceRKOuzXBFWglmBp1WMWzPWVMtCOhwgkI5WkYNuGtQ32s Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:19:30.638963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}] Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestVolumeBootPattern-545913659 Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b19967e2b09342e9ac006151002bf71a Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:19:30.640616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '6135799a-c691-4c98-af12-4cce0ab2da1a'} Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:30.641568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:19:30.643038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:30.644331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Returning 404 to user: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:30.644331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-40519267-f662-4d62-b9b2-06cec5c6b754 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 404 len: 111 microversion: 2.1 time: 0.030241 Jun 20 06:19:30.644331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 620/965] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:30 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:19:30.678845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-42935975-6e78-4c3b-98f8-c051edc181a1 req-215fa9d9-7bef-4bea-986b-154aff533e6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6135799a-c691-4c98-af12-4cce0ab2da1a", "name": "network-vif-deleted", "tag": "dd7d7a75-898c-4bff-8619-68169fbb9797"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:30.687273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-42935975-6e78-4c3b-98f8-c051edc181a1 req-215fa9d9-7bef-4bea-986b-154aff533e6c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:30.687822 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-42935975-6e78-4c3b-98f8-c051edc181a1 req-215fa9d9-7bef-4bea-986b-154aff533e6c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:30.699261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-42935975-6e78-4c3b-98f8-c051edc181a1 req-215fa9d9-7bef-4bea-986b-154aff533e6c service nova] Creating event network-vif-deleted:dd7d7a75-898c-4bff-8619-68169fbb9797 for instance 6135799a-c691-4c98-af12-4cce0ab2da1a on hv-cinder-80403 Jun 20 06:19:30.704277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-42935975-6e78-4c3b-98f8-c051edc181a1 req-215fa9d9-7bef-4bea-986b-154aff533e6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029012 Jun 20 06:19:30.705150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 621/966] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:30.741296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-852064568", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1814282609", "security_groups": [{"name": "tempest-secgroup-smoke-1167724178"}], "block_device_mapping_v2": [{"uuid": "b3a97b01-4448-4b67-981c-4886c6a4cfe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a963e-b480-49e6-9783-3876a7922a09"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:30.888960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] validate_networks() for [('f55a963e-b480-49e6-9783-3876a7922a09', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:19:31.401010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:19:31.401434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:19:31.401909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:19:31.402313 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:19:31.402722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:19:31.411271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:31.411719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:31.412508 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:31.412997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:31.429350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:19:31.433740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for user b19967e2b09342e9ac006151002bf71a and project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:19:31.490266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:19:31.492479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3a97b01-4448-4b67-981c-4886c6a4cfe8',volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:19:31.627691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a01970d8-24ee-4515-945b-e581b1a9c9dc tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.890666 Jun 20 06:19:31.633173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 622/967] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:19:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:19:31.633326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:31.634501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:31.643805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:31.644281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:31.645279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:31.645741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:31.679669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:31.680062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:31.681195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lazy-loading 'fault' on Instance uuid ba092673-d9fc-41fc-8951-70d3ece80024 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:31.729612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e1516d2903414b7caf082c32dcdac3eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f7a1ff44e2a455ba4260b74ae06b50c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:31.738618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d5189c1b-edab-41e3-9c6a-8e208b828e6a tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 200 len: 1311 microversion: 2.1 time: 0.108624 Jun 20 06:19:31.739199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 623/968] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:31 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:31.745108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5098203f-4580-4551-9d01-8072494014b1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:31.745726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5098203f-4580-4551-9d01-8072494014b1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:31.807804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5098203f-4580-4551-9d01-8072494014b1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:31.815120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5098203f-4580-4551-9d01-8072494014b1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1094 microversion: 2.1 time: 0.074941 Jun 20 06:19:31.815750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 624/969] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:31 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:32.726154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-620c2cd3-c1fe-495d-8ecc-234faaa85c00 req-a90f72b6-d106-4cd2-b9ec-611261f229c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba092673-d9fc-41fc-8951-70d3ece80024", "name": "network-vif-deleted", "tag": "2576bc04-b00f-4cc8-b5d6-fee542d47216"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:32.737609 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-620c2cd3-c1fe-495d-8ecc-234faaa85c00 req-a90f72b6-d106-4cd2-b9ec-611261f229c1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.738100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-620c2cd3-c1fe-495d-8ecc-234faaa85c00 req-a90f72b6-d106-4cd2-b9ec-611261f229c1 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.749015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-620c2cd3-c1fe-495d-8ecc-234faaa85c00 req-a90f72b6-d106-4cd2-b9ec-611261f229c1 service nova] Creating event network-vif-deleted:2576bc04-b00f-4cc8-b5d6-fee542d47216 for instance ba092673-d9fc-41fc-8951-70d3ece80024 on hv-cinder-80403 Jun 20 06:19:32.753978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-620c2cd3-c1fe-495d-8ecc-234faaa85c00 req-a90f72b6-d106-4cd2-b9ec-611261f229c1 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031757 Jun 20 06:19:32.754585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 625/970] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:32.760026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:32.760749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] [instance: ba092673-d9fc-41fc-8951-70d3ece80024] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:32.767556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.768099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.768998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.769505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.784474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] HTTP exception thrown: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Request method failure captured: Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 HTTP/1.1 Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-J8yVqXlvOU9pICRZquWgc6kRnsz6Lcq0D6hxi4Vrduz-utYb-xv1OmgyPq5UmHKsPSHOTR3x-KoqzIoSAh3iEjRh10PIWIz6ednYSLb-_geiar9iS2pa1PxXPbHeTvRJq4oGfGcJQayLtEH2kL4L07-iejUc1D8xrf6uPNHakhLA Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:19:32.786370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/9f7a1ff44e2a455ba4260b74ae06b50c"}]}] Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 9f7a1ff44e2a455ba4260b74ae06b50c Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1870547187 Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: e1516d2903414b7caf082c32dcdac3eb Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1870547187-project Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. Jun 20 06:19:32.787993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'ba092673-d9fc-41fc-8951-70d3ece80024'} Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:32.788938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. Jun 20 06:19:32.790433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:32.791943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] Returning 404 to user: Instance ba092673-d9fc-41fc-8951-70d3ece80024 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:32.791943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-519730c1-a4b2-4537-82d4-659f86246212 tempest-ServerRescueNegativeTestJSON-1870547187 tempest-ServerRescueNegativeTestJSON-1870547187-project] 10.222.0.39 "GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024" status: 404 len: 111 microversion: 2.1 time: 0.032045 Jun 20 06:19:32.791943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 626/971] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:32 2022] GET /compute/v2.1/servers/ba092673-d9fc-41fc-8951-70d3ece80024 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:19:32.840017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:32.840871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:32.848588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.849201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:32.849871 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:32.850319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:33.205056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:33.213509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4337aed2-c9d6-463b-b4ce-48143c965d7a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1210 microversion: 2.1 time: 0.381146 Jun 20 06:19:33.214241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 627/972] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:32 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1210 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:34.230995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:34.232844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:34.240037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.240808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.241605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.242056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.455037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:34.463252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6ecb0c3b-84db-4c1e-9a17-d7f1f11d69c2 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.236675 Jun 20 06:19:34.472564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 628/973] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:34 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:34.475250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:34.475736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:34.482894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.483369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.484197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.484634 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.527707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8f4bef2b-23cd-4e52-8756-ef87434dc412 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056628 Jun 20 06:19:34.528962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 629/974] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:19:34 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 20 06:19:34.630967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:34.631483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:34.641383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.641844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.642678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.643071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.699948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:19:34.827305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8022dbbd-8358-46cd-856f-a9521885c5ba tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 204 len: 0 microversion: 2.1 time: 0.204806 Jun 20 06:19:34.827895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 630/975] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:19:34 2022] DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:19:34.836901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-2f4473f3-dce3-4d57-a64b-bd8c53fe5c28 req-59143cce-4d66-42d0-876c-2c83b34a27d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd0bd75-da64-4cf4-ae19-4e2e961a4860", "tag": "4c0e5135-e66c-4043-85ae-c343bfa67dd9"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:34.845511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2f4473f3-dce3-4d57-a64b-bd8c53fe5c28 req-59143cce-4d66-42d0-876c-2c83b34a27d2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.845963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2f4473f3-dce3-4d57-a64b-bd8c53fe5c28 req-59143cce-4d66-42d0-876c-2c83b34a27d2 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.857897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-2f4473f3-dce3-4d57-a64b-bd8c53fe5c28 req-59143cce-4d66-42d0-876c-2c83b34a27d2 service nova] Creating event network-changed:4c0e5135-e66c-4043-85ae-c343bfa67dd9 for instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 on hv-cinder-80403 Jun 20 06:19:34.863377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-2f4473f3-dce3-4d57-a64b-bd8c53fe5c28 req-59143cce-4d66-42d0-876c-2c83b34a27d2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032263 Jun 20 06:19:34.863992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 631/976] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:34.869398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:34.870118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:34.876839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.877320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.878100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:34.878552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:34.895402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:35.038588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:35.059449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-29657793-9001-41e5-8ae9-5764210b66fd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1673 microversion: 2.1 time: 0.194266 Jun 20 06:19:35.074610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 632/977] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:34 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1673 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:35.480309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:35.481294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:35.488149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:35.488693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:35.489587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:35.490100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:35.675139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:35.684467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a1d84785-6316-46b9-babe-2ff129e28c4c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.208803 Jun 20 06:19:35.685565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 633/978] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:35 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:36.080250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:36.080918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:36.088194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:36.088653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:36.092378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:36.093146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:36.301465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:36.310194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f83002b8-0dd8-42b5-9b8d-eb5aafc5dc02 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1673 microversion: 2.1 time: 0.235566 Jun 20 06:19:36.310865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 634/979] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:36 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1673 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:36.703738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:36.704422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:36.712165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:36.713226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:36.714019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:36.714460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:36.916743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:36.924389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f21852a6-2633-49ba-bd1c-b8a6ddc8bac1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.224545 Jun 20 06:19:36.925206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 635/980] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:36 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:37.327814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:37.328429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:37.343531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:37.343986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:37.344789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:37.345243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:37.669317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:37.678396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dbb6f9e3-45fa-4abe-94b5-c6c1b4f229da tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1673 microversion: 2.1 time: 0.354184 Jun 20 06:19:37.679368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 636/981] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:37 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1673 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:37.943766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:37.945150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:37.953607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:37.954190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:37.955055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:37.955562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:38.219263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:38.250230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8eb4e44-c645-419f-87c7-7bd2616b2fe1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.297104 Jun 20 06:19:38.250230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 637/982] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:37 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:38.434514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-6ad8b9f3-7de9-4a24-a4af-64d4c52661ef req-ee397351-6024-4425-892a-211f4068594c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db62494c-25f7-4eab-8c22-5c48182d5a5a", "name": "network-vif-deleted", "tag": "bfaf0961-1cb5-4edf-b383-b51c377b031f"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:38.464074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6ad8b9f3-7de9-4a24-a4af-64d4c52661ef req-ee397351-6024-4425-892a-211f4068594c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:38.465201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6ad8b9f3-7de9-4a24-a4af-64d4c52661ef req-ee397351-6024-4425-892a-211f4068594c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:38.490234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-6ad8b9f3-7de9-4a24-a4af-64d4c52661ef req-ee397351-6024-4425-892a-211f4068594c service nova] Creating event network-vif-deleted:bfaf0961-1cb5-4edf-b383-b51c377b031f for instance db62494c-25f7-4eab-8c22-5c48182d5a5a on hv-cinder-80403 Jun 20 06:19:38.505350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-6ad8b9f3-7de9-4a24-a4af-64d4c52661ef req-ee397351-6024-4425-892a-211f4068594c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074353 Jun 20 06:19:38.506036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 638/983] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:38.700224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:38.701670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:38.708253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:38.708910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:38.709715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:38.710399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:38.752803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:38.753279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:38.753786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lazy-loading 'fault' on Instance uuid db62494c-25f7-4eab-8c22-5c48182d5a5a {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:19:38.809443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:38.819908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fe61e847-8d59-4198-b37c-eb1c315b20a9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 200 len: 1327 microversion: 2.1 time: 0.126395 Jun 20 06:19:38.830174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 639/984] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:38 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 1327 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:39.206034 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:19:39.206854 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:19:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:19:39.259305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:39.259966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:39.269104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:39.269844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:39.270834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:39.271454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:39.434137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:39.449946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-41fe315e-b31e-4311-b3e4-c0683868e1b4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.195398 Jun 20 06:19:39.460005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 640/985] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:39 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:39.840797 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:39.842047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:39.848872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:39.849962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:39.851344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:39.853061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:39.874488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a HTTP/1.1 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:19:39.876759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:19:39.878324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'db62494c-25f7-4eab-8c22-5c48182d5a5a'} Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:19:39.879236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:19:39.880691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:19:39.883042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:19:39.883042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d09f5d07-d9b5-4df7-81f1-524ebc3cafc9 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 404 len: 111 microversion: 2.1 time: 0.043161 Jun 20 06:19:39.883042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 641/986] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:39 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:19:39.891165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4ab01de6-b571-4e95-80a6-aef4096130dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '.version_select at 0x7f21ed0849d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:39.919839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4ab01de6-b571-4e95-80a6-aef4096130dc tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001380228" status: 202 len: 0 microversion: 2.1 time: 0.035677 Jun 20 06:19:39.920744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 642/987] 10.222.0.39 () {58 vars in 1220 bytes} [Mon Jun 20 06:19:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001380228 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:19:40.466915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:40.468858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:40.476183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:40.477025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:40.478491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:40.479172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:40.682657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:40.690231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5671a861-d0d3-4158-a2a8-fa09ec23d634 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.227408 Jun 20 06:19:40.690807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 643/988] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:40 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:40.695415 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5fe15f36-89ec-40bc-b5e1-248184f498f2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: .version_select at 0x7f21ed25d790>, body: {"keypair": {"name": "tempest-keypair-1717010862", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkclDmhhxTmQ661mY09doOpNXlUCg3ppqUb2KFeBFckdJAm7zaoGDRIRYlFPp8pp3xWoQO9pCzxcRdQbt2wcKNcp/A1eI1RUs1SuDW8AECfMLSVFdUUVCMvi+5BVjRhpA=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:40.710203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-5fe15f36-89ec-40bc-b5e1-248184f498f2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for project 873857d11992429d8f3a064665c1fc3e. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:19:40.713075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:40.715514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-5fe15f36-89ec-40bc-b5e1-248184f498f2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for user b511b8f2ba394fa9b276f76a52247184 and project 873857d11992429d8f3a064665c1fc3e. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:19:40.740644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5fe15f36-89ec-40bc-b5e1-248184f498f2 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048815 Jun 20 06:19:40.741451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 644/989] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:19:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:41.704217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:41.708720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:41.709335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:41.716389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:41.716912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:41.717870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:41.718318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:41.863324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:41.872328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-53d71797-4895-4b54-9fea-14167681ab40 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.168704 Jun 20 06:19:41.881549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 645/990] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:41 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:42.192667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1973990271", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c8ff1f54-998c-40b7-bb8d-98d84313c769"}], "security_groups": [{"name": "tempest-securitygroup--1793941187"}], "key_name": "tempest-keypair-1717010862", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:42.295603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] validate_networks() for [('c8ff1f54-998c-40b7-bb8d-98d84313c769', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:19:42.683320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:19:42.683840 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:19:42.684324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:19:42.684755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:19:42.685215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:19:42.694145 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:42.694672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:42.695549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:42.697249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:42.715669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for project 873857d11992429d8f3a064665c1fc3e. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:19:42.719837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Getting quotas for user b511b8f2ba394fa9b276f76a52247184 and project 873857d11992429d8f3a064665c1fc3e. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:19:42.731753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:19:42.734141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:19:42.781229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ea8f2d94-bd8d-4457-9eb2-4edde5b39584 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.592755 Jun 20 06:19:42.781986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 646/991] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:19:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:19:42.796121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0d3e5b68-2e4b-4d2b-a2a7-4fdeaa654854 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:42.796121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0d3e5b68-2e4b-4d2b-a2a7-4fdeaa654854 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:42.856423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0d3e5b68-2e4b-4d2b-a2a7-4fdeaa654854 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:42.863134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0d3e5b68-2e4b-4d2b-a2a7-4fdeaa654854 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1238 microversion: 2.1 time: 0.075237 Jun 20 06:19:42.863708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 647/992] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:42 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1238 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:42.889952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:42.890654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:42.897118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:42.897685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:42.898534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:42.899108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.054521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:43.075899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d6ad3493-90e5-4d4a-96ab-661868f3b6f5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.189903 Jun 20 06:19:43.087287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 648/993] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:42 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:43.879818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:43.880438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:43.891198 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.891954 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.892876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:43.893541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:43.987185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:43.995885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-37754966-69cb-41c4-bed7-98fd704cd0a0 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1298 microversion: 2.1 time: 0.119728 Jun 20 06:19:43.998380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 649/994] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:43 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1298 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:44.095764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:44.096392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:44.104033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:44.104493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:44.105946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:44.106652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:44.325076 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:44.342118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7e861a3a-1644-4021-a138-8afc0d860d58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.249081 Jun 20 06:19:44.353777 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 650/995] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:44 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:45.017594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:45.018220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:45.024990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.025445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.026217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.026651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.210432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:45.218879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9ad27d5f-454e-4d8f-bc90-02ee2727d4b4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.207802 Jun 20 06:19:45.219459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 651/996] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:45 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:45.360971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:45.361749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:45.368779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.369462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.370399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.370996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.637605 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:45.655061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-82dff426-d556-49a9-a851-629f856f54d5 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.298075 Jun 20 06:19:45.655799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 652/997] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:45 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:45.663212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-b1066869-9ecc-4bb2-b9e7-67c09722261d req-959a100c-9061-4db5-8c8a-3cae7c6e3440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944ce698-6e30-4fc4-b584-5800424ad9ef", "tag": "72febb40-d841-4a11-9e23-523690c84617"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:45.672387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b1066869-9ecc-4bb2-b9e7-67c09722261d req-959a100c-9061-4db5-8c8a-3cae7c6e3440 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:45.673306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b1066869-9ecc-4bb2-b9e7-67c09722261d req-959a100c-9061-4db5-8c8a-3cae7c6e3440 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:45.686492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-b1066869-9ecc-4bb2-b9e7-67c09722261d req-959a100c-9061-4db5-8c8a-3cae7c6e3440 service nova] Creating event network-changed:72febb40-d841-4a11-9e23-523690c84617 for instance 944ce698-6e30-4fc4-b584-5800424ad9ef on hv-cinder-80403 Jun 20 06:19:45.691640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-b1066869-9ecc-4bb2-b9e7-67c09722261d req-959a100c-9061-4db5-8c8a-3cae7c6e3440 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Jun 20 06:19:45.692243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 653/998] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:46.028724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-c4138639-fd55-4e2f-ad36-67260d470616 req-1a612693-3bde-4fa1-bceb-f682eeee4f0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0bd75-da64-4cf4-ae19-4e2e961a4860", "name": "network-vif-plugged", "status": "completed", "tag": "4c0e5135-e66c-4043-85ae-c343bfa67dd9"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:46.039167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c4138639-fd55-4e2f-ad36-67260d470616 req-1a612693-3bde-4fa1-bceb-f682eeee4f0b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:46.040370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c4138639-fd55-4e2f-ad36-67260d470616 req-1a612693-3bde-4fa1-bceb-f682eeee4f0b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:46.052369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-c4138639-fd55-4e2f-ad36-67260d470616 req-1a612693-3bde-4fa1-bceb-f682eeee4f0b service nova] Creating event network-vif-plugged:4c0e5135-e66c-4043-85ae-c343bfa67dd9 for instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 on hv-cinder-80403 Jun 20 06:19:46.058773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-c4138639-fd55-4e2f-ad36-67260d470616 req-1a612693-3bde-4fa1-bceb-f682eeee4f0b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035348 Jun 20 06:19:46.059821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 654/999] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:46.237302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:46.237999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:46.245093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:46.245547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:46.246309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:46.246753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:46.249359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:46.378047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:46.385659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-632b4c53-d6e5-4afb-800c-69ca40ef2063 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.152595 Jun 20 06:19:46.386226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 655/1000] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:46 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:46.841239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:46.841864 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:46.848536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:46.849341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:46.850960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:46.850960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:47.002857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:47.011231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dac2972a-b51a-4daa-a276-487d19170012 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.343456 Jun 20 06:19:47.011799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 656/1001] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:46 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:47.402620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:47.403282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:47.409699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:47.410155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:47.411033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:47.411479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:47.542567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:47.550031 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b3c3a060-a31c-4479-9242-335f48c68d47 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.151710 Jun 20 06:19:47.550607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 657/1002] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:47 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:48.028112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:48.028901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:48.035712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:48.036181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:48.037024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:48.037477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:48.186764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:48.194440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cdd90c9e-5d09-4b71-a9bc-8c412dc45355 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.170907 Jun 20 06:19:48.195040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 658/1003] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:48 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:48.567422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:48.568050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:48.576379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:48.576934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:48.578292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:48.579044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:48.825655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:48.833367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bd775206-a3fc-4dd5-940f-f3bce74bafc8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.269854 Jun 20 06:19:48.834085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 659/1004] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:48 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:49.211350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:49.212106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:49.218815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:49.219273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:49.220045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:49.220486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:49.352102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:49.360125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c1f1001b-37f0-43e4-b27b-3f288b17523b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.152619 Jun 20 06:19:49.360689 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 660/1005] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:49 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:49.851773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:49.852415 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:49.859962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:49.860421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:49.861241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:49.861688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:50.002893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:50.010716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-79274fb9-4026-43c2-a048-20212a72156a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.163028 Jun 20 06:19:50.011393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 661/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:49 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:50.043940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-b78178c0-29f0-44f7-9066-d3af6da752af req-78e33a41-4646-410a-8cbd-48c8b035191b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944ce698-6e30-4fc4-b584-5800424ad9ef", "name": "network-vif-plugged", "status": "completed", "tag": "72febb40-d841-4a11-9e23-523690c84617"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:50.052521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b78178c0-29f0-44f7-9066-d3af6da752af req-78e33a41-4646-410a-8cbd-48c8b035191b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:50.053013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b78178c0-29f0-44f7-9066-d3af6da752af req-78e33a41-4646-410a-8cbd-48c8b035191b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:50.064953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-b78178c0-29f0-44f7-9066-d3af6da752af req-78e33a41-4646-410a-8cbd-48c8b035191b service nova] Creating event network-vif-plugged:72febb40-d841-4a11-9e23-523690c84617 for instance 944ce698-6e30-4fc4-b584-5800424ad9ef on hv-cinder-80403 Jun 20 06:19:50.069701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-b78178c0-29f0-44f7-9066-d3af6da752af req-78e33a41-4646-410a-8cbd-48c8b035191b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030333 Jun 20 06:19:50.070288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 662/1007] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:19:50.378491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:50.379087 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:50.385918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:50.386374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:50.387156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:50.387593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:50.565541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:50.576406 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-db8a4ac3-2c7b-4b0f-801a-fec0aa923b20 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1266 microversion: 2.1 time: 0.202189 Jun 20 06:19:50.577052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 663/1008] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:50 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1266 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:19:51.027567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:51.028178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:51.034658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.035113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.035879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.036320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.176629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:51.184556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-39a7053a-bb94-4634-b583-034a40eacd19 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.161015 Jun 20 06:19:51.185151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 664/1009] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:51 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:51.593182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:51.593809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:51.599712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.600165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.600947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.601388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.728312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:51.736620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-caf3859f-8c36-4520-83ff-9ce915ec947b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1452 microversion: 2.1 time: 0.147310 Jun 20 06:19:51.737211 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 665/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:51 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1452 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:51.751698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:51.752301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:51.757910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.758363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.759125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:51.759563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:51.887936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:51.895369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8c53f64e-2a18-4b07-870b-873670c7fb05 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1452 microversion: 2.1 time: 0.147159 Jun 20 06:19:51.895931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 666/1011] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:51 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1452 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:52.201779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:52.203238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:52.210754 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:52.211567 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:52.212657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:52.214380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:52.364129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:52.375533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d90dcf24-7c16-480e-951c-306d30edb7dd tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1364 microversion: 2.1 time: 0.178219 Jun 20 06:19:52.377299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 667/1012] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:52 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:53.393234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:53.394055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:53.396124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:53.396940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=20 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:19:53.403781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.404314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.405121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.405556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.543963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:19:53.551692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d7445d49-6446-4460-b51c-ec1fcc376965 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1549 microversion: 2.1 time: 0.162314 Jun 20 06:19:53.552285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 668/1013] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:19:53 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:19:53.568209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:19:53.568725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:19:53.575762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.576214 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.577022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.577589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.689363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0691c013-2a4f-4932-848b-3dbd98cb8155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124005 Jun 20 06:19:53.689363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 669/1014] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:19:53 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:53.843728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-0ae1a26a-fa8a-4fbd-8c3a-e094ee8f34bc req-1bad951b-1e0e-46ab-8883-3c163cd0180f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd0bd75-da64-4cf4-ae19-4e2e961a4860", "tag": "4c0e5135-e66c-4043-85ae-c343bfa67dd9"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:53.854715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0ae1a26a-fa8a-4fbd-8c3a-e094ee8f34bc req-1bad951b-1e0e-46ab-8883-3c163cd0180f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:53.856737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0ae1a26a-fa8a-4fbd-8c3a-e094ee8f34bc req-1bad951b-1e0e-46ab-8883-3c163cd0180f service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:53.872950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-0ae1a26a-fa8a-4fbd-8c3a-e094ee8f34bc req-1bad951b-1e0e-46ab-8883-3c163cd0180f service nova] Creating event network-changed:4c0e5135-e66c-4043-85ae-c343bfa67dd9 for instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 on hv-cinder-80403 Jun 20 06:19:53.879004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-0ae1a26a-fa8a-4fbd-8c3a-e094ee8f34bc req-1bad951b-1e0e-46ab-8883-3c163cd0180f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040909 Jun 20 06:19:53.880625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 670/1015] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:19:55.895269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-32262c0e-4ebc-450d-9376-8f959de1a367 req-e4a82fae-c7fa-403e-9c3e-9dbe6caaf790 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "944ce698-6e30-4fc4-b584-5800424ad9ef", "tag": "72febb40-d841-4a11-9e23-523690c84617"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:19:55.903988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-32262c0e-4ebc-450d-9376-8f959de1a367 req-e4a82fae-c7fa-403e-9c3e-9dbe6caaf790 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:19:55.904430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-32262c0e-4ebc-450d-9376-8f959de1a367 req-e4a82fae-c7fa-403e-9c3e-9dbe6caaf790 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:19:55.914937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-32262c0e-4ebc-450d-9376-8f959de1a367 req-e4a82fae-c7fa-403e-9c3e-9dbe6caaf790 service nova] Creating event network-changed:72febb40-d841-4a11-9e23-523690c84617 for instance 944ce698-6e30-4fc4-b584-5800424ad9ef on hv-cinder-80403 Jun 20 06:19:55.920020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-32262c0e-4ebc-450d-9376-8f959de1a367 req-e4a82fae-c7fa-403e-9c3e-9dbe6caaf790 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029420 Jun 20 06:19:55.920654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 671/1016] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:22.036689 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:22.037814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=87 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:22.042158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:22.042745 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:22.050624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.051079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.052159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.052309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.093517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-756241f0-b304-47cc-ab30-72cdfbf8a49e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/ips" status: 200 len: 149 microversion: 2.1 time: 0.058318 Jun 20 06:20:22.094600 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 672/1017] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:20:22 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/ips => generated 149 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:22.524504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:22.525181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:22.532975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.544455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.550130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:22.550749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:22.631733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-af144be6-02a0-4a8d-b3f9-e1ef77eff3c2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/ips" status: 200 len: 153 microversion: 2.20 time: 0.110831 Jun 20 06:20:22.632882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 673/1018] 10.222.0.39 () {60 vars in 1288 bytes} [Mon Jun 20 06:20:22 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/ips => generated 153 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 20 06:20:23.160671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c0e8af92-9464-46c1-8408-c4181f765258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Action: 'create', calling method: .version_select at 0x7f21ed0f1550>, body: {"keypair": {"name": "tempest-TestShelveInstance-535861818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEiZ2OVmBAqYPyjRiN+wKI6oBmGT4OhsMiwTb79DqCtebXeocDXxnnEwt+CbTjqETL8PdhxpvUPUp6n0c4Sm1QMOGNJtlmxUHgaf80UoltJB9nWjX8v8VwSUV1L5VWBa7A=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:23.180369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-c0e8af92-9464-46c1-8408-c4181f765258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Getting quotas for project 4c7d8d09f3b94090bbb08abbc1842a42. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:20:23.187232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-c0e8af92-9464-46c1-8408-c4181f765258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Getting quotas for user d8ff165426d14c09a7221a910ca7febc and project 4c7d8d09f3b94090bbb08abbc1842a42. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:20:23.212437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c0e8af92-9464-46c1-8408-c4181f765258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.243703 Jun 20 06:20:23.213119 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 674/1019] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:20:22 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:23.635998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cecdb15-357b-4299-baa7-29debeedbf8c"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:23.637217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:23.645236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:23.646101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:23.646979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:23.647425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:23.991883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a4632add-abeb-4dad-9249-1430228676b8 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.359793 Jun 20 06:20:23.992529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 675/1020] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:20:23 2022] POST /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments => generated 194 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:25.680228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:25.680888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:25.688071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:25.688528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:25.689341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:25.689787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:25.713264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lazy-loading 'flavor' on Instance uuid fce81df8-2c3a-441f-a1ae-2977c58fecc3 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:20:25.987226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e64361d4-7b27-4e63-b918-7d658ba8506b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/action" status: 202 len: 0 microversion: 2.20 time: 0.311622 Jun 20 06:20:25.990881 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 676/1021] 10.222.0.39 () {62 vars in 1318 bytes} [Mon Jun 20 06:20:25 2022] POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:20:25.997773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:25.998522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:26.005504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:26.005967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:26.006979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:26.007642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:26.164537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.176918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.178708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:26.179924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2069ef6c-0a06-4477-8860-6181913203ab tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.187413 Jun 20 06:20:26.180644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 677/1022] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:25 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:27.199497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:27.210015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:27.216963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:27.217667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:27.218668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:27.219591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:27.380616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.391857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.393649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:27.394873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-325b2a69-dcd1-47e4-a1d5-acf76feb0e10 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.199778 Jun 20 06:20:27.395547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 678/1023] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:27 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:28.413232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:28.413852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:28.420714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:28.421172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:28.421947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:28.422383 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:28.565110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.572935 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.575646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:28.576843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-00f9028d-4048-4cdc-89c6-169b55bb5cb6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.167639 Jun 20 06:20:28.577451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 679/1024] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:28 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:29.595270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:29.595889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:29.602391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:29.602861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:29.603711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:29.604121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:29.741929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.750360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.751870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:29.753153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b4e1f70-bbae-45f8-a597-6d4248829f2b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.162218 Jun 20 06:20:29.753723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 680/1025] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:29 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:30.771393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:30.772049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:30.778839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:30.779220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:30.779981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:30.780945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:30.919389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:30.929642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:30.931207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:30.932381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fb928347-eed9-4d87-9b87-5928d0dc292d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.165043 Jun 20 06:20:30.932965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 681/1026] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:30 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:31.551681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cecdb15-357b-4299-baa7-29debeedbf8c"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:31.552857 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:31.559057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.559469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.560324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.560803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.642678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: POST /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments HTTP/1.1 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 74 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:20:31.644403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {"volumeAttachment": {"volumeId": "9cecdb15-357b-4299-baa7-29debeedbf8c"}} Jun 20 06:20:31.646139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'server_id': 'd66b01e5-b7b8-4259-8fc4-88aafb3a66b8', 'body': {'volumeAttachment': {'volumeId': '9cecdb15-357b-4299-baa7-29debeedbf8c'}}} Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:31.647000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:31.648215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 400 to user: Invalid volume: volume 9cecdb15-357b-4299-baa7-29debeedbf8c is already attached to instances: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d80864f1-5a1f-4cbe-9702-ac1b7bdaa595 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098390 Jun 20 06:20:31.649497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 682/1027] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:20:31 2022] POST /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:20:31.706763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:31.707276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:31.713431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.713892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.714669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.715110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.795586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lazy-loading 'services' on Instance uuid d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:20:31.872951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-83c55a2c-dbeb-45ff-9614-3c3e6475a791 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments/9cecdb15-357b-4299-baa7-29debeedbf8c" status: 202 len: 0 microversion: 2.1 time: 0.170859 Jun 20 06:20:31.874020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 683/1028] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:20:31 2022] DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments/9cecdb15-357b-4299-baa7-29debeedbf8c => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:20:31.883784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:31.884851 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:31.891608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.892088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.892971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.893763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.924722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-848c2487-0559-4577-b982-5c951155da19 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Jun 20 06:20:31.925296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 684/1029] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:20:31 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:31.950290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:31.951085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:31.957638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.958100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:31.958884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:31.959328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:32.092615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.101356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.102957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:32.104218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d4270d74-3fba-4033-9da8-89b7ba1f4c6d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.157720 Jun 20 06:20:32.104810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 685/1030] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:31 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:32.935890 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:32.937580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:32.944395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:32.944891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:32.945665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:32.946107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:32.949873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:32.977465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-df927a55-e0bb-4c08-8230-1da03f4b4eb7 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045732 Jun 20 06:20:32.978020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 686/1031] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:20:32 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:20:33.037945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:33.038445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.044485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.044988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.045805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.047249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.073319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:20:33.151161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-347d98d6-841e-40c2-92b3-3c356e7d21e1 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 204 len: 0 microversion: 2.1 time: 0.116667 Jun 20 06:20:33.151978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 687/1032] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:20:33 2022] DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:20:33.157440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:33.158137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.164182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.164575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.165371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.165809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.198122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:33.302490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.310603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.313257 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.314512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-39b424a4-b7da-464f-b973-00394704f0aa tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.161617 Jun 20 06:20:33.315078 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 688/1033] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:33 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:33.320683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:33.321326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:33.327354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.328412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.329223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:33.329669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:33.466786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:33.475623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cc5be2d2-a443-456f-ab37-14789d76413d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1681 microversion: 2.1 time: 0.158744 Jun 20 06:20:33.476192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 689/1034] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:33 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:34.332956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:34.333611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:34.340146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:34.340601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:34.341411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:34.342115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:34.480565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.490129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.491659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.492934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c146dad7-47af-44c4-9300-9b1120cecbd7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.164272 Jun 20 06:20:34.493683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 690/1035] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:34 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:34.508811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:34.509434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:34.515665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:34.516123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:34.516929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:34.517375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:34.652128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:34.660310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e405d152-a1e0-41c2-a796-6d3d5aa14da4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1681 microversion: 2.1 time: 0.165874 Jun 20 06:20:34.660914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 691/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:34 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1681 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:35.511633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:35.513446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:35.520243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.520690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:35.521679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.522282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:35.738554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.748554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.751038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:35.752650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-19dd1da0-a5c1-47da-bffa-e411be6a7417 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.244899 Jun 20 06:20:35.753250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 692/1037] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:35 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:35.757872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:35.758486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:35.766180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.766978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:35.767675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:35.767860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.005272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.014397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d958911e-ff78-40e9-9fbe-f126e2b05eff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 200 len: 1681 microversion: 2.1 time: 0.260112 Jun 20 06:20:36.015043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 693/1038] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:35 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 1681 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:36.238799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-1953a7fa-4c04-4a76-9a53-5bfe7e27c4ad req-a3e136b3-686f-47a9-aa94-d4ad729bbb2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d66b01e5-b7b8-4259-8fc4-88aafb3a66b8", "name": "network-vif-deleted", "tag": "a17f2293-5544-4c88-ac14-ab8970fdf4ae"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:36.251657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-1953a7fa-4c04-4a76-9a53-5bfe7e27c4ad req-a3e136b3-686f-47a9-aa94-d4ad729bbb2e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:36.252191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-1953a7fa-4c04-4a76-9a53-5bfe7e27c4ad req-a3e136b3-686f-47a9-aa94-d4ad729bbb2e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.272106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-1953a7fa-4c04-4a76-9a53-5bfe7e27c4ad req-a3e136b3-686f-47a9-aa94-d4ad729bbb2e service nova] Creating event network-vif-deleted:a17f2293-5544-4c88-ac14-ab8970fdf4ae for instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 on hv-cinder-80403 Jun 20 06:20:36.277101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-1953a7fa-4c04-4a76-9a53-5bfe7e27c4ad req-a3e136b3-686f-47a9-aa94-d4ad729bbb2e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042081 Jun 20 06:20:36.277782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 694/1039] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:36.772561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:36.773561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:36.780798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:36.781486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.782504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:36.782971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:36.935317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.944807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.946510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:36.947804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-439313c2-b096-44ae-ba07-6cbbd9c04826 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.180046 Jun 20 06:20:36.948481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 695/1040] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:36 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:37.032631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:37.033274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:37.041129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.041588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:37.042369 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.042808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:37.058862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 HTTP/1.1 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:20:37.062547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:20:37.064277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'd66b01e5-b7b8-4259-8fc4-88aafb3a66b8'} Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:20:37.065373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:20:37.066992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:20:37.068173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:20:37.068173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c1b7c7cc-7b65-4915-aa12-47019eddcead tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 404 len: 111 microversion: 2.1 time: 0.035479 Jun 20 06:20:37.068173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 696/1041] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:37 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:20:37.074041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b0a8d26a-9fb0-4824-98de-3d73d16c7230 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '.version_select at 0x7f21ed1ce310>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:37.099808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b0a8d26a-9fb0-4824-98de-3d73d16c7230 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753984848" status: 202 len: 0 microversion: 2.1 time: 0.029356 Jun 20 06:20:37.100481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 697/1042] 10.222.0.39 () {58 vars in 1217 bytes} [Mon Jun 20 06:20:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753984848 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:20:37.733120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a0fbc3d5-3a0b-4645-9231-c109f9353221 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: .version_select at 0x7f21ed1b0b80>, body: {"keypair": {"name": "tempest-keypair-1997389621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPVVsfJV+cAngksT+pJg6NkQGRjFxIaQ93Pm7t+snx4BIDqtcPWCVh/NBWlLNasBFTTFkZHD7j/7165QWsXUUtx+sA77C9jmW4n1G7KQVYzt6sDmHpQz6GN6xO3VAp3N2w=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:37.747551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-a0fbc3d5-3a0b-4645-9231-c109f9353221 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:20:37.753090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-a0fbc3d5-3a0b-4645-9231-c109f9353221 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:20:37.774481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a0fbc3d5-3a0b-4645-9231-c109f9353221 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045532 Jun 20 06:20:37.775155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 698/1043] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:20:37 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:37.966017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:37.966639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:37.973303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.973792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:37.974570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:37.975021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:38.161262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.169208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.170715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:38.173189 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-685287fb-c727-4258-a3a0-6398f112e884 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.211220 Jun 20 06:20:38.173758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 699/1044] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:37 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:39.194625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-398408642", "imageRef": "4472a663-398b-4677-91eb-4467366dddd3", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e482afaf-8e11-49aa-a25e-27526ac7158f"}], "security_groups": [{"name": "tempest-securitygroup--1037167638"}], "key_name": "tempest-keypair-1997389621", "user_data": "}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:39.296360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] validate_networks() for [('e482afaf-8e11-49aa-a25e-27526ac7158f', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:20:39.666364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:20:39.666800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:20:39.667283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:20:39.667704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:20:39.668126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:20:39.677527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.677987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:39.678799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.679247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:39.695801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:20:39.699783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Getting quotas for user 68c4b81f2f704a9bbe15fd0f3326bb3e and project adba1d74cb2441a9a238dc0e6a47c112. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:20:39.711265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:20:39.713687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='4472a663-398b-4677-91eb-4467366dddd3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:20:39.728746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:39.769498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5996ac25-6865-470a-b6e2-fc146dea2b49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.579134 Jun 20 06:20:39.774996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 700/1045] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:20:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 581 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:20:39.775306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:39.775925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:39.782755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.783206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:39.784001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:39.784446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:39.923215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:39.931397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:39.933011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:39.934213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-451ee8c4-1662-42f0-9e3f-bbd9e1e9e35f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.162838 Jun 20 06:20:39.934766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 701/1046] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:39 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:39.950706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ec0e9eae-4528-4328-aa3a-7b02d68e9d8c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:39.951317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ec0e9eae-4528-4328-aa3a-7b02d68e9d8c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:40.006655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ec0e9eae-4528-4328-aa3a-7b02d68e9d8c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:40.013484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ec0e9eae-4528-4328-aa3a-7b02d68e9d8c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1241 microversion: 2.1 time: 0.066421 Jun 20 06:20:40.014284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 702/1047] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:39 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1241 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:40.954191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:40.954820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:40.962072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:40.962563 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:40.963377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:40.964094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:41.118859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.128045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.129762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.130977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3a01eaea-fb85-4d39-ba73-44f3c43acf64 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.181425 Jun 20 06:20:41.131547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 703/1048] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:40 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:41.135914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:41.136525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:41.143603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:41.144059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:41.144937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:41.145382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:41.214091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:41.221584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-45672707-d5b3-4f14-8129-d4ee2d99c13c tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1299 microversion: 2.1 time: 0.089065 Jun 20 06:20:41.222163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 704/1049] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:41 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1299 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:42.150458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:42.151095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:42.157805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.158262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.159427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.159565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.412381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.430579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.432093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.433298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7315bbd6-9adf-49ec-a469-ea0d520c157d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.286901 Jun 20 06:20:42.434040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 705/1050] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:42 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:42.439110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-a22b08ae-7311-482f-82c5-91097361bec4 req-498873b0-889d-44f9-8d91-0d13f863d4d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "name": "network-vif-plugged", "status": "completed", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:42.450431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a22b08ae-7311-482f-82c5-91097361bec4 req-498873b0-889d-44f9-8d91-0d13f863d4d4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.450873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-a22b08ae-7311-482f-82c5-91097361bec4 req-498873b0-889d-44f9-8d91-0d13f863d4d4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.462652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:42.465784 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-a22b08ae-7311-482f-82c5-91097361bec4 req-498873b0-889d-44f9-8d91-0d13f863d4d4 service nova] Creating event network-vif-plugged:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:20:42.476168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-a22b08ae-7311-482f-82c5-91097361bec4 req-498873b0-889d-44f9-8d91-0d13f863d4d4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040716 Jun 20 06:20:42.476889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 706/1051] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:42.482275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:42.482970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:42.491177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.491636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.492416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.492891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.907259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:42.914806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dd68b5e4-82a9-4061-bb01-d08f56af0f8b tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.436805 Jun 20 06:20:42.915371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 707/1052] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:42 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:42.920319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-c1e4f671-80c3-4b6e-ac73-f9ef8efb425a req-d349949e-209a-4875-9ea6-c9bc675757a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90eeea79-d68d-4847-99c8-a74a5db5c356", "tag": "5b2deef5-f052-4897-9d09-85729b149be7"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:42.929306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c1e4f671-80c3-4b6e-ac73-f9ef8efb425a req-d349949e-209a-4875-9ea6-c9bc675757a4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:42.929721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c1e4f671-80c3-4b6e-ac73-f9ef8efb425a req-d349949e-209a-4875-9ea6-c9bc675757a4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:42.941081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-c1e4f671-80c3-4b6e-ac73-f9ef8efb425a req-d349949e-209a-4875-9ea6-c9bc675757a4 service nova] Creating event network-changed:5b2deef5-f052-4897-9d09-85729b149be7 for instance 90eeea79-d68d-4847-99c8-a74a5db5c356 on hv-cinder-80403 Jun 20 06:20:42.945873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-c1e4f671-80c3-4b6e-ac73-f9ef8efb425a req-d349949e-209a-4875-9ea6-c9bc675757a4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029381 Jun 20 06:20:42.946456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 708/1053] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:43.454159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:43.454911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:43.461988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.462446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:43.463232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.463808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:43.597704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.605576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.607345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:43.609618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e35856b8-ae7d-4ed3-af88-9fd352cf7993 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.159750 Jun 20 06:20:43.610193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 709/1054] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:43 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:43.931951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:43.932655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:43.939896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.940354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:43.941160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:43.941599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:44.067799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.075164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0ad0538d-d0e0-49be-b3a3-23659ed5dc04 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.147179 Jun 20 06:20:44.075729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 710/1055] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:43 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:44.627946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:44.628569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:44.635153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:44.635611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:44.636379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:44.636855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:44.768636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.776433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.777976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:44.779140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-94f90e72-6467-4aea-b0e7-c462056fe6c5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.155665 Jun 20 06:20:44.779707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 711/1056] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:44 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:45.092195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:45.093472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:45.099562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.100014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:45.100813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.101256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:45.226231 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:45.234388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6e4e56ab-146c-4020-aa19-360b4a66299d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.146074 Jun 20 06:20:45.234902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 712/1057] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:45 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:45.798136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:45.798824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:45.805403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.805867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:45.806642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:45.807089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:45.935859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:45.944367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:45.945907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:45.947055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d1bf5ebe-d675-4a83-9d17-929bf0cfca7d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.153359 Jun 20 06:20:45.947624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 713/1058] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:45 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:46.250919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:46.251528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:46.257809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:46.258278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:46.259054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:46.259500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:46.386678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:46.394866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-568fb2da-eff8-4932-8acf-75e565f27947 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.147789 Jun 20 06:20:46.395442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 714/1059] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:46 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:46.965207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:46.965854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:46.972366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:46.972855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:46.973611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:46.974048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:47.100026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.108144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.109687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.110884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1f1fc5d6-949c-4320-80ac-152dd5ec900c tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.149539 Jun 20 06:20:47.111453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 715/1060] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:46 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:47.411293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:47.411908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:47.417888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:47.418335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:47.419121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:47.419557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:47.634186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:47.641841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aa4fc75c-1ea0-40c4-8581-333f42f72aca tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.234427 Jun 20 06:20:47.642408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 716/1061] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:47 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:48.128925 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:48.129560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:48.136242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.136633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.137429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.137866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.268251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.276509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.278111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.279274 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7634bbe4-398f-4cae-800c-92fb5c23cc83 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.154335 Jun 20 06:20:48.280505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 717/1062] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:48 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:48.658817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:48.659461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:48.665457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.665911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.666668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:48.667107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:48.800715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:48.808134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-27609769-1b0b-459c-a4e4-e1c26236ac99 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.153307 Jun 20 06:20:48.808726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 718/1063] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:48 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:49.297456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:49.298111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:49.304537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.305025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:49.305796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.306235 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:49.440100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.448180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.449714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:49.450895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-50697d0a-3375-4dfe-a359-9c0f2b6e2de3 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1746 microversion: 2.20 time: 0.157304 Jun 20 06:20:49.451451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 719/1064] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:49 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:49.827638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:49.828693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:49.832006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:49.841782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.842539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:49.843519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:49.844251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:50.011847 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=12 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:50.023653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:50.032557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5da2bdfe-65d6-4988-8f6a-4210254f2e37 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.211450 Jun 20 06:20:50.033161 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 720/1065] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:49 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:50.281298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1658763034", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-535861818", "security_groups": [{"name": "tempest-secgroup-smoke-1654786734"}], "networks": [{"uuid": "0871f723-e90a-49ca-8818-86965263d609"}], "block_device_mapping_v2": [{"uuid": "5f2e3e44-3743-4f17-9b22-1d2577c62375", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:50.429941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] validate_networks() for [('0871f723-e90a-49ca-8818-86965263d609', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:20:50.848761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:20:50.849776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:20:50.850421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:20:50.851032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:20:50.851456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:20:50.863655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:50.864553 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:50.866239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:50.867063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:50.887862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Getting quotas for project 4c7d8d09f3b94090bbb08abbc1842a42. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:20:50.895208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Getting quotas for user d8ff165426d14c09a7221a910ca7febc and project 4c7d8d09f3b94090bbb08abbc1842a42. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:20:50.959859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:20:50.962051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5f2e3e44-3743-4f17-9b22-1d2577c62375',volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:20:51.107615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fe5562b6-9cd2-4145-a3ca-65c2035b77b9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.831042 Jun 20 06:20:51.113583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 721/1066] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:20:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:20:51.114629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-0612e237-bcb3-482e-8ec9-ce86a44ed6b7 req-f8ebc59d-daa0-49cc-9bd0-ee464855cdfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90eeea79-d68d-4847-99c8-a74a5db5c356", "name": "network-vif-plugged", "status": "completed", "tag": "5b2deef5-f052-4897-9d09-85729b149be7"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:51.132793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0612e237-bcb3-482e-8ec9-ce86a44ed6b7 req-f8ebc59d-daa0-49cc-9bd0-ee464855cdfa service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.133097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-0612e237-bcb3-482e-8ec9-ce86a44ed6b7 req-f8ebc59d-daa0-49cc-9bd0-ee464855cdfa service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.147434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-0612e237-bcb3-482e-8ec9-ce86a44ed6b7 req-f8ebc59d-daa0-49cc-9bd0-ee464855cdfa service nova] Creating event network-vif-plugged:5b2deef5-f052-4897-9d09-85729b149be7 for instance 90eeea79-d68d-4847-99c8-a74a5db5c356 on hv-cinder-80403 Jun 20 06:20:51.153289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-0612e237-bcb3-482e-8ec9-ce86a44ed6b7 req-f8ebc59d-daa0-49cc-9bd0-ee464855cdfa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042924 Jun 20 06:20:51.154499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 722/1067] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:51.162375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:51.163217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:51.170852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.171521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.172422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.173131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.383992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:51.395043 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:51.396796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:51.398167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-47ec4281-a490-41ed-baa0-65aea19cd8fb tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.241282 Jun 20 06:20:51.411365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 723/1068] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:51 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:20:51.416451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:51.417353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:51.423942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.424616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.425677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.426275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.634558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:51.644693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2e3df4d8-c01b-4e1b-8597-11e384a7c8db tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.231868 Jun 20 06:20:51.646099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 724/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:51 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:51.657014 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:51.657695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:51.664457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.664951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.665778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:51.666295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:51.686773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:51.733990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:51.742251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a7635472-e12c-49e9-a219-1282ff593311 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1138 microversion: 2.1 time: 0.092250 Jun 20 06:20:51.742958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 725/1070] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:51 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1138 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:52.417377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:52.418450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:52.427368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.427826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.428595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.429330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.570926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.581025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.583149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.583941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-299379d4-2080-4fd6-b7ee-cb96bb0edf7e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.170545 Jun 20 06:20:52.584564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 726/1071] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:52 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:52.664841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:52.666178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:52.673323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.674038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.674938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.675530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.849990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.858190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-34801bb3-ab58-4219-9200-50853757b7e4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1367 microversion: 2.1 time: 0.198418 Jun 20 06:20:52.867816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 727/1072] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:52 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:52.872484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:52.873124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:52.879773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.880260 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.881060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:52.881497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:52.946882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:52.955787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-41b03569-986f-4173-a98a-7d93e1495acc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1186 microversion: 2.1 time: 0.086904 Jun 20 06:20:52.956396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 728/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:52 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:53.602781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:53.603751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:53.610987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.611446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:53.612222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.612669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:53.759319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.769181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.770929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:53.772312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-39afb974-1ba1-4d02-bb2a-4d9eff487c3b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.173475 Jun 20 06:20:53.781029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 729/1074] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:53 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:53.876626 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:53.877289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:53.887627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.888090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:53.890460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:53.891886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.102206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:54.111516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6d5f552f-9bd4-461f-92f7-82b6d5e5bb26 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1557 microversion: 2.1 time: 0.239856 Jun 20 06:20:54.124107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 730/1075] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:53 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1557 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:54.128818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:54.129446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:54.136802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.137265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.138044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.138483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.217913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:54.228268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0d08efae-ea22-432e-b3d4-7c82a6ab9fb8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1204 microversion: 2.1 time: 0.103120 Jun 20 06:20:54.239647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 731/1076] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:54 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1204 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:54.244782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:54.245413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:54.252625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.253206 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.254159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.254611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.389213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d74934c0-28e0-45e9-8a22-1e02db66414d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.147709 Jun 20 06:20:54.397527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 732/1077] 10.222.0.39 () {58 vars in 1274 bytes} [Mon Jun 20 06:20:54 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:54.793598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:54.796476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:54.814392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.815108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:54.818154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:54.820775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.066717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.078140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.079723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.080971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1810e238-956c-49d1-9fad-47adba78ca0b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.293758 Jun 20 06:20:55.083653 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 733/1078] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:54 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:55.249652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:55.250817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:55.277166 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:55.278329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.279174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:55.279778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.674724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:55.692106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4bf2fd66-9da3-4ad4-a82b-837bd0ca2c39 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.448944 Jun 20 06:20:55.697212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 734/1079] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:55 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:55.826105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-60fbc5a5-f0dd-4a53-b0cf-7c394d275670 req-ce05adea-94a3-4b19-91d2-6e977962cdfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90eeea79-d68d-4847-99c8-a74a5db5c356", "tag": "5b2deef5-f052-4897-9d09-85729b149be7"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:55.835485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-60fbc5a5-f0dd-4a53-b0cf-7c394d275670 req-ce05adea-94a3-4b19-91d2-6e977962cdfe service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:55.835938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-60fbc5a5-f0dd-4a53-b0cf-7c394d275670 req-ce05adea-94a3-4b19-91d2-6e977962cdfe service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:55.853704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-60fbc5a5-f0dd-4a53-b0cf-7c394d275670 req-ce05adea-94a3-4b19-91d2-6e977962cdfe service nova] Creating event network-changed:5b2deef5-f052-4897-9d09-85729b149be7 for instance 90eeea79-d68d-4847-99c8-a74a5db5c356 on hv-cinder-80403 Jun 20 06:20:55.861631 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-60fbc5a5-f0dd-4a53-b0cf-7c394d275670 req-ce05adea-94a3-4b19-91d2-6e977962cdfe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038844 Jun 20 06:20:55.863303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 735/1080] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:20:56.100242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:56.102618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:56.112090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.113006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.114187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.114798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.641276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.652008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.656437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:56.658079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c8b2c9b6-8cbe-4c6d-8048-c4b912d84f57 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.562391 Jun 20 06:20:56.659321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 736/1081] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:56 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:56.667360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-5e5932fa-4823-4749-a72e-389f78b0f35c req-b9a66869-4783-41d5-abb5-1b0dc51d4afe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:20:56.678135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5e5932fa-4823-4749-a72e-389f78b0f35c req-b9a66869-4783-41d5-abb5-1b0dc51d4afe service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.678900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5e5932fa-4823-4749-a72e-389f78b0f35c req-b9a66869-4783-41d5-abb5-1b0dc51d4afe service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.693568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-5e5932fa-4823-4749-a72e-389f78b0f35c req-b9a66869-4783-41d5-abb5-1b0dc51d4afe service nova] Creating event network-changed:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:20:56.699878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-5e5932fa-4823-4749-a72e-389f78b0f35c req-b9a66869-4783-41d5-abb5-1b0dc51d4afe service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038745 Jun 20 06:20:56.701044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 737/1082] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:20:56.715448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:56.716385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:56.724585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.725429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:56.726366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:56.727212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.080614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:57.114134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d9e3b043-9129-4191-972c-bd9799784feb tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.387027 Jun 20 06:20:57.115015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 738/1083] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:56 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:20:57.675816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:57.676371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:57.683105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.683561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.684340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:57.684813 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:57.821445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:57.832147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:57.833870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:57.834914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1ec524fb-3246-47c8-a731-8c6d50a019be tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.163162 Jun 20 06:20:57.835727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 739/1084] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:57 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:58.131435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:58.132122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:58.135148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=95 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:20:58.138998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:58.139455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:58.140220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:58.140656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:58.280254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:58.288532 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f0c6b6ef-d1ae-4c16-9dcd-4d4a40593fcc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.160879 Jun 20 06:20:58.289394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 740/1085] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:58 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:20:58.888077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:58.891834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:58.899554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:58.900297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:58.901288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:58.902443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.146094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.154481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.155999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.157284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a91d4cea-4f90-4d98-90f5-4a32be161048 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.307812 Jun 20 06:20:59.167969 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 741/1086] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:20:58 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:20:59.306685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:20:59.307221 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:20:59.314042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.314503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.315271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:20:59.315713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:20:59.463437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:20:59.472026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b2ae043f-2893-416f-8465-7a02ce4eac74 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.169404 Jun 20 06:20:59.472725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 742/1087] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:20:59 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:00.175449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:00.176069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:00.182300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.182752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.183520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.183953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.324945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.328893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:00.334213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.335724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.336946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-de69a845-f5f8-4323-9a1d-fd9ae1719d35 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.165381 Jun 20 06:21:00.337523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 743/1088] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:00 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:00.490122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:00.490776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:00.502622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.503084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.503863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:00.504305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:00.654112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:00.663026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e9815748-316a-45f7-ac9a-c98e1e8d2ddc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.176975 Jun 20 06:21:00.663622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 744/1089] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:00 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:01.359132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:01.359768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:01.361582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:01.362716 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=6 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:01.370092 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.370556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.371348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.371791 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.523305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.532815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.534324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.535493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9526939b-345c-4a60-9c13-c8e4247b7dd2 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1741 microversion: 2.20 time: 0.181821 Jun 20 06:21:01.536058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 745/1090] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:01 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:01.680424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:01.681090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:01.687668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.688118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.688911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:01.689347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:01.816102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:01.823649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b36cc471-e3f3-45b4-85f7-797b18bdc122 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.147034 Jun 20 06:21:01.824216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 746/1091] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:01 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:02.554963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:02.555591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:02.562385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.562844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:02.563618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.564061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:02.774956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:02.782915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:02.784400 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:02.785596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5be48856-1874-4e40-99b2-b8706e786509 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1723 microversion: 2.20 time: 0.234537 Jun 20 06:21:02.786368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 747/1092] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:02 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:02.840353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:02.840996 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:02.847090 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.847542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:02.848304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:02.848771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.071029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.079114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1eae0b0f-1acc-49e3-a364-1bfbb8ddd299 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.242532 Jun 20 06:21:03.079721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 748/1093] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:02 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:03.804649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:03.805279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:03.812215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.812674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.813466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:03.813907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:03.945583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.954224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.955743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:03.956939 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70174641-d141-489d-b15c-97ba41dca132 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1723 microversion: 2.20 time: 0.156321 Jun 20 06:21:03.957506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 749/1094] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:03 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:04.096101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:04.096637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:04.102790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.103251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.104023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.104466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.232906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:04.240319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ae2270e7-0ca2-47b5-8280-ee7049952d8f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.148870 Jun 20 06:21:04.240910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 750/1095] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:04 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:04.975779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:04.976420 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:04.985403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.985875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:04.986662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:04.987112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.209410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.217810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.219651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.220853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70938d3d-d57b-4128-88d8-a7c9c8583aa4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1723 microversion: 2.20 time: 0.249189 Jun 20 06:21:05.221413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 751/1096] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:04 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1723 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:05.257048 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:05.257590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:05.263367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.263998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.264786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:05.265226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:05.407262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:05.414668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5f2491e3-886d-445f-b2a6-4f74bc4fa6c8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.161307 Jun 20 06:21:05.415246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 752/1097] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:05 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:06.240141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:06.240921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.247211 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.247675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.249619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.250066 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.382307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.390487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.392005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.393225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d1eef54a-3b32-4328-bad2-b190a29e1b6b tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1726 microversion: 2.20 time: 0.157387 Jun 20 06:21:06.393794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 753/1098] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:06 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:06.398141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-87626774-048a-4b25-8325-92fcdd677208 req-f8554dd5-fe3f-48c5-ae91-30cf3a741627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "name": "network-vif-unplugged", "status": "completed", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:06.406158 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-87626774-048a-4b25-8325-92fcdd677208 req-f8554dd5-fe3f-48c5-ae91-30cf3a741627 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.406615 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-87626774-048a-4b25-8325-92fcdd677208 req-f8554dd5-fe3f-48c5-ae91-30cf3a741627 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.419539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-87626774-048a-4b25-8325-92fcdd677208 req-f8554dd5-fe3f-48c5-ae91-30cf3a741627 service nova] Creating event network-vif-unplugged:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:21:06.425252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-87626774-048a-4b25-8325-92fcdd677208 req-f8554dd5-fe3f-48c5-ae91-30cf3a741627 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030228 Jun 20 06:21:06.425866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 754/1099] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:06.432360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "edc50715-0bbe-43d1-9482-4d8cfa91a2d5"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:06.433524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.440622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.441115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.441878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.442319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.707192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-12ab297e-3c39-454e-abac-654c857bfa9a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.278884 Jun 20 06:21:06.707789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 755/1100] 10.222.0.39 () {62 vars in 1363 bytes} [Mon Jun 20 06:21:06 2022] POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments => generated 188 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 20 06:21:06.712539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:06.713120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.719971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.720427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.721270 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.721705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.857381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:06.864964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-42ded3e9-88ae-44d6-bb06-5a4640d29c37 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.156130 Jun 20 06:21:06.865536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 756/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:06 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:06.870236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:06.870733 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:06.876446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.876940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.877712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:06.878157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:06.964678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=4,nova_cell1:UPDATE=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:07.115360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fb56a079-fc14-44f8-8624-f7a1c0619a40 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments/edc50715-0bbe-43d1-9482-4d8cfa91a2d5" status: 202 len: 0 microversion: 2.20 time: 0.248675 Jun 20 06:21:07.116125 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 757/1102] 10.222.0.39 () {60 vars in 1456 bytes} [Mon Jun 20 06:21:06 2022] DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments/edc50715-0bbe-43d1-9482-4d8cfa91a2d5 => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:21:07.175140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:07.175709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:07.182225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.182680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.183448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.183888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.264869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8b10ef69-4908-4a68-baaa-e4ee2cc0a0f6 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/action" status: 202 len: 0 microversion: 2.20 time: 0.097935 Jun 20 06:21:07.265693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 758/1103] 10.222.0.39 () {62 vars in 1318 bytes} [Mon Jun 20 06:21:07 2022] POST /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:21:07.273302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:07.273916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:07.280216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.280720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.281513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.281952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.457168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.465185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.466703 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:07.467990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-31b44be9-d927-4c04-89f3-c437d0bca501 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1674 microversion: 2.20 time: 0.198393 Jun 20 06:21:07.468549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 759/1104] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:07 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:07.881898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:07.882505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:07.888537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.889094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:07.889849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:07.890283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.034072 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:08.041506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-883e0fc6-17d3-43a9-849f-4fcc72c1e776 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.163449 Jun 20 06:21:08.042071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 760/1105] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:07 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:08.486550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:08.487228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:08.493782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.494237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.494999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:08.495444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:08.710082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:08.718577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:08.720075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:08.721290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4bc701f8-d75f-4410-bfc7-2f7fb34f525a tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.238705 Jun 20 06:21:08.721855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 761/1106] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:08 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:09.058839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:09.059465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:09.065569 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.066019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.066939 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.067378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.204659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.212913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-55f24c6a-b075-4a8e-9c9b-3c657d422e96 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.157834 Jun 20 06:21:09.213657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 762/1107] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:09 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:09.740481 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:09.741228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:09.747967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.748811 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.749606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:09.750044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:09.887036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.895547 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.897097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:09.898294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4994efae-266e-42ca-87e8-bdba400cd7dc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.161744 Jun 20 06:21:09.909594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 763/1108] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:09 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:10.230173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:10.231050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:10.238150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.238612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.239398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.239845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.416628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:10.425111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-63802131-cede-4266-b9d6-5cdac5f14253 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.198688 Jun 20 06:21:10.425927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 764/1109] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:10 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:10.439516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-c53e6970-7677-43b2-9f24-26155effe71a req-bd8f6792-a772-4693-a802-a622cb4b9d3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "name": "network-vif-plugged", "status": "completed", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:10.461987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c53e6970-7677-43b2-9f24-26155effe71a req-bd8f6792-a772-4693-a802-a622cb4b9d3a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.462433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-c53e6970-7677-43b2-9f24-26155effe71a req-bd8f6792-a772-4693-a802-a622cb4b9d3a service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.475442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-c53e6970-7677-43b2-9f24-26155effe71a req-bd8f6792-a772-4693-a802-a622cb4b9d3a service nova] Creating event network-vif-plugged:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:21:10.480410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-c53e6970-7677-43b2-9f24-26155effe71a req-bd8f6792-a772-4693-a802-a622cb4b9d3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044488 Jun 20 06:21:10.481321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 765/1110] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:10.918603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:10.919334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:10.927551 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.928266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:10.929242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:10.930082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.076070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.085045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.086545 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.087711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-03f69933-c4f5-4fc9-963f-004e86adb3ad tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.174100 Jun 20 06:21:11.088271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 766/1111] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:10 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:11.442830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:11.443456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:11.449949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:11.450406 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.451218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:11.451660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:11.592500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:11.601712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c9f29377-39c1-4d69-8772-59375662a340 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.162720 Jun 20 06:21:11.602317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 767/1112] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:11 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:12.106268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:12.106944 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:12.113668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.114132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.114917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.115365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.257523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.266378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.267903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.269131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-697d4fc6-52ad-43fe-99ee-6b409e167d09 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.167097 Jun 20 06:21:12.269704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 768/1113] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:12 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:12.618287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:12.618900 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:12.625691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.626141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.626908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:12.627343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:12.760531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:12.769114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4b9dd495-773e-44b4-9fe4-31b544321128 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.154590 Jun 20 06:21:12.770029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 769/1114] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:12 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:13.288660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:13.289432 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:13.297546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.298006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.298793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.299236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.456104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.464389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.465982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.467191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5039afc6-b827-4fbe-911e-c572ce9cd964 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.183562 Jun 20 06:21:13.468304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 770/1115] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:13 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:13.786623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:13.787271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:13.793397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.793864 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.794675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:13.795094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:13.930612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:13.938580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9c1548e4-b34b-4055-a67f-f4aa045b5516 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.156010 Jun 20 06:21:13.939318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 771/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:13 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:14.486562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:14.487458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:14.494167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.494621 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.495402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.495841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.516128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:14.650042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.659726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.663782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:14.663782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-91d33f0c-be06-45aa-a543-05c836685d99 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.179932 Jun 20 06:21:14.663782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 772/1117] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:14 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:14.956052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:14.956658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:14.964212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.964751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:14.965528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:14.965960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.106294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:15.115434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a7841479-7e6b-4a9f-885a-d4e950e42258 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.163909 Jun 20 06:21:15.116029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 773/1118] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:14 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:15.681056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:15.681767 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:15.689872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.690335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.691114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:15.691558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:15.835976 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:15.844868 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:15.846407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:15.847598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a7ab25a9-e3e0-4627-aad8-fae6b33a0aca tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.170608 Jun 20 06:21:15.848366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 774/1119] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:15 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:16.132958 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:16.133602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:16.141698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.142156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.142926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.143360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.286776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:16.294250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-49b53317-5ec5-4301-a43d-9508dbc99bdc tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.165277 Jun 20 06:21:16.294823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 775/1120] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:16 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:16.866586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:16.867351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:16.874670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.875140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:16.875918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:16.876360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.019022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.027568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.029111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.031292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a8752af6-fa99-4238-84be-d8e25bb502ae tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.168281 Jun 20 06:21:17.031445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 776/1121] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:16 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:17.311636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:17.312250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:17.318393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:17.318852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.319624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:17.320063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:17.460220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:17.469647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-006fc774-58a8-422c-97e4-0c66f5e7f4af tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.161843 Jun 20 06:21:17.470438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 777/1122] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:17 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:18.049193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:18.050260 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:18.056658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.057140 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.057910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.058375 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.206442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.214596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.216100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.217328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-805c5d0f-fdaf-4c81-b4ff-3fe971f5517d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.173165 Jun 20 06:21:18.218286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 778/1123] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:18 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:18.487613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:18.488396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:18.494878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.495345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.496130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:18.496577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:18.633833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:18.641786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e6744a99-2384-4c8f-843a-62946d4774be tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.158858 Jun 20 06:21:18.642371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 779/1124] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:18 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:19.235670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:19.236352 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:19.243082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:19.243557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:19.244312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:19.244770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:19.382429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:19.391899 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:19.393535 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:19.394766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-793d5076-fea8-4841-8b91-5b6b94be14d5 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.163214 Jun 20 06:21:19.395341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 780/1125] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:19 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:19.658806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:19.659336 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:19.665389 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:19.665839 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:19.666597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:19.667139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:19.803967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:19.812013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7f7674eb-50a2-449a-b174-a08e8c47a4f8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.156813 Jun 20 06:21:19.812586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 781/1126] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:19 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:20.219462 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:21:20.220403 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:21:20.547347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:20.548009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:20.554368 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:20.554831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:20.555608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:20.556050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:20.688251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:20.696186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:20.697730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:20.698907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d8673a88-df98-4d83-b512-cedf3785b15d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.290740 Jun 20 06:21:20.699473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 782/1127] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:20 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:20.828301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:20.828866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:20.834904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:20.835360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:20.836131 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:20.836576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:20.965356 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:20.973401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-614d3785-1d14-4212-88fa-cc4ef4ce5e0d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.149190 Jun 20 06:21:20.973963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 783/1128] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:20 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:21.455750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:21.456310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:21.462324 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.462783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:21.463562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.464000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:21.487174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7980e415-6009-4022-a602-1f82f750d207 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/ips" status: 200 len: 145 microversion: 2.1 time: 0.168308 Jun 20 06:21:21.487737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 784/1129] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:21:21 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/ips => generated 145 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:21.716437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:21.718242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:21.724162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.724620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:21.725534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.725984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:21.859445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:21.867568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:21.869326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:21.870269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ab2b9298-022c-492f-9014-73ce5454541f tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.157693 Jun 20 06:21:21.870843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 785/1130] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:21 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:21.990258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:21.990865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:21.996772 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.997224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:21.997978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:21.998444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:22.126574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:22.133995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7c43d0d4-30f2-4f4f-a874-1ae0f74b0d3f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.147544 Jun 20 06:21:22.134568 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 786/1131] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:21 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:22.889604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:22.890428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:22.896945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:22.897410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:22.898183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:22.898632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.036300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:23.048721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:23.051265 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:23.053095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-04bd440d-df3d-432a-b151-f433626bc9f0 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.167732 Jun 20 06:21:23.054123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 787/1132] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:22 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:23.151139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:23.151787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:23.158240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.158698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.159466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.159908 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.288606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:23.296965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-23aead28-d56d-4730-9bc1-570d8add2076 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.149627 Jun 20 06:21:23.297529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 788/1133] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:23 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:23.843528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc4494db-b30e-492f-a705-bf45e880cec5"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:23.844743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:23.847761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:23.851936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.852403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.853212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:23.853662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:23.868358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:25.859329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f12e0feb-013b-4a85-ad75-8d65aefd63f3 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.019835 Jun 20 06:21:25.860077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 789/1134] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:21:23 2022] POST /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 194 bytes in 2022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:25.865329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:25.866102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:25.872903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:25.874280 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:25.875515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:25.876037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:26.055602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:26.063526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:26.065059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:26.066223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-736f0de3-75c9-4e77-8b1d-1b3384961609 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.205184 Jun 20 06:21:26.066788 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 790/1135] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:25 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:26.071082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:26.071710 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:26.077290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:26.077749 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:26.078516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:26.078957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:26.207162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:26.214640 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-88713cc3-5f2b-42e1-a0b9-8a9c64cfc203 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1260 microversion: 2.1 time: 0.146909 Jun 20 06:21:26.215306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 791/1136] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:26 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:27.083634 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:27.084325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:27.090692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.091163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.091930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.092804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.528169 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:27.537241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:27.538764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:27.539928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7820883d-65a5-4e0c-b821-3f6453b52503 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.460308 Jun 20 06:21:27.540492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 792/1137] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:27 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:27.544829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:27.546259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:27.552062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.552518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.553330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.553770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.686554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:27.694109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4eff9651-2b39-4342-90ae-164259e9a361 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1444 microversion: 2.1 time: 0.152636 Jun 20 06:21:27.694748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 793/1138] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:27 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:21:27.710075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:27.710622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:27.716269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.716755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.718645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:27.719094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:27.846460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:27.854011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c26d2d30-c2b7-4bbb-be8c-e6ab8f464766 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1444 microversion: 2.1 time: 0.147505 Jun 20 06:21:27.854587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 794/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:27 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1444 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:28.560216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:28.561714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:28.567769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:28.568236 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:28.569133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:28.569523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:28.708372 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:28.716645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:28.718479 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:28.719773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-719f3c35-0d3a-42ba-ab9b-e51f6e95156d tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.164068 Jun 20 06:21:28.720399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 795/1140] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:28 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:29.534287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-012b02e1-e262-4e8f-947f-c7773396a162 req-8292ab0d-b8cf-4a4f-a181-53ee94793924 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:29.542475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-012b02e1-e262-4e8f-947f-c7773396a162 req-8292ab0d-b8cf-4a4f-a181-53ee94793924 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:29.542923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-012b02e1-e262-4e8f-947f-c7773396a162 req-8292ab0d-b8cf-4a4f-a181-53ee94793924 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:29.555018 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-012b02e1-e262-4e8f-947f-c7773396a162 req-8292ab0d-b8cf-4a4f-a181-53ee94793924 service nova] Creating event network-changed:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:21:29.559831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-012b02e1-e262-4e8f-947f-c7773396a162 req-8292ab0d-b8cf-4a4f-a181-53ee94793924 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029386 Jun 20 06:21:29.560426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 796/1141] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:21:29.739680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:29.740422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:29.746753 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:29.747207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:29.747978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:29.748469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:29.951960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:29.962354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:29.963910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:29.965136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-578c0860-dcfe-4dc2-a2c6-7d9434899dce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.230174 Jun 20 06:21:29.966027 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 797/1142] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:29 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:30.573855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-ecccc819-aed5-415c-ab3b-1c5810798593 req-76276623-15d2-4c14-b1bf-e5d69606668d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "name": "network-vif-plugged", "status": "completed", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:30.582682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ecccc819-aed5-415c-ab3b-1c5810798593 req-76276623-15d2-4c14-b1bf-e5d69606668d service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:30.583154 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ecccc819-aed5-415c-ab3b-1c5810798593 req-76276623-15d2-4c14-b1bf-e5d69606668d service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:30.596816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-ecccc819-aed5-415c-ab3b-1c5810798593 req-76276623-15d2-4c14-b1bf-e5d69606668d service nova] Creating event network-vif-plugged:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:21:30.602279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-ecccc819-aed5-415c-ab3b-1c5810798593 req-76276623-15d2-4c14-b1bf-e5d69606668d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032074 Jun 20 06:21:30.602959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 798/1143] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:30.983699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:30.984393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:30.991100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:30.991550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:30.992311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:30.992770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:31.125562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:31.133404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:31.134903 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:31.136051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a2ed7e9a-dd7f-404c-8b3c-98394772a230 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.156942 Jun 20 06:21:31.136614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 799/1144] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:30 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:32.155509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:32.156172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:32.162723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:32.163176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:32.163931 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:32.164367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:32.297032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:32.304785 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:32.306279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:32.307428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dda3f8ce-6b9a-48cc-94da-259015bcf0b4 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.156498 Jun 20 06:21:32.307983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 800/1145] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:32 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:33.325823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:33.326471 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:33.333144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.333572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.334331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:33.334766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:33.466340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:33.474823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:33.476347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:33.477560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bbf53a3b-3f0a-409e-884a-3f094a339cce tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1732 microversion: 2.20 time: 0.155691 Jun 20 06:21:33.478129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 801/1146] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:33 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:21:34.426320 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:34.427266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:34.433677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.434133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.434901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.435343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.466136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-48a1693a-03fc-496d-b880-d3aa16628af1 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Jun 20 06:21:34.466734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 802/1147] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:34 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:34.476732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:34.477240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:34.483365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.484340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.485136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.485579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.516258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9fb5955e-2cfa-40bc-a6ce-4b38a6a51b09 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5" status: 200 len: 194 microversion: 2.1 time: 0.042661 Jun 20 06:21:34.517055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 803/1148] 10.222.0.39 () {58 vars in 1412 bytes} [Mon Jun 20 06:21:34 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:34.521534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:34.522155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:34.528286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.528943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.529608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:34.530082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:34.662345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:34.671244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:34.673234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:34.674497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf21fa5f-1a6e-424e-948b-de02f1c8a663 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1719 microversion: 2.20 time: 0.156424 Jun 20 06:21:34.675062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 804/1149] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:21:34 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:21:35.840167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9df9e06-5ac9-4ad4-a816-4abc15b19895"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:35.841357 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:35.847905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.848354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:35.849139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:35.849577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:36.002311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:36.117718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fa67edcc-4839-426d-b658-d7298808c227 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "POST /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281133 Jun 20 06:21:36.118329 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 805/1150] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:21:35 2022] POST /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:42.776564 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:21:42.777153 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:21:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:21:43.613321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.614964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.622182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.622581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.623364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.624429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.654083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c06cf2e2-4a74-403e-ad86-d2f349be6856 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045898 Jun 20 06:21:43.654647 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 806/1151] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:43 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:43.796253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.796907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.803412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.803873 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.804664 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.805134 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.833608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2640460b-2a93-49f6-bef3-aaef58682747 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5" status: 200 len: 194 microversion: 2.1 time: 0.041825 Jun 20 06:21:43.834196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 807/1152] 10.222.0.39 () {58 vars in 1412 bytes} [Mon Jun 20 06:21:43 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:43.843097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:43.843596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:43.849281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.849738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.850499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:43.850940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:43.932639 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lazy-loading 'services' on Instance uuid 944ce698-6e30-4fc4-b584-5800424ad9ef {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:21:44.004997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-677629ff-1313-4673-a2e5-5195fba94c28 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5" status: 202 len: 0 microversion: 2.1 time: 0.165252 Jun 20 06:21:44.005633 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 808/1153] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:21:43 2022] DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/fc4494db-b30e-492f-a705-bf45e880cec5 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:21:46.169403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:46.169998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:46.176841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:46.177354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:46.178104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:46.178546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:46.208119 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-23b398fd-b208-440f-8279-089dfbda23f5 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/b9df9e06-5ac9-4ad4-a816-4abc15b19895" status: 200 len: 194 microversion: 2.1 time: 0.043579 Jun 20 06:21:46.208694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 809/1154] 10.222.0.39 () {58 vars in 1412 bytes} [Mon Jun 20 06:21:46 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/b9df9e06-5ac9-4ad4-a816-4abc15b19895 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:46.217748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:46.218721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:46.224318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:46.224808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:46.225570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:46.226010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:46.304935 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lazy-loading 'services' on Instance uuid 944ce698-6e30-4fc4-b584-5800424ad9ef {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:21:46.376665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2f419d51-4c6d-4ad9-b7bd-7590e99c967e tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/b9df9e06-5ac9-4ad4-a816-4abc15b19895" status: 202 len: 0 microversion: 2.1 time: 0.162223 Jun 20 06:21:46.377250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 810/1155] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:21:46 2022] DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments/b9df9e06-5ac9-4ad4-a816-4abc15b19895 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:21:47.538430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:47.539446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:47.545844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.546301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.547073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.547516 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.575061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b8c711e8-dd66-4411-85b2-d5e4f72504e8 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041458 Jun 20 06:21:47.575608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 811/1156] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:47 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:21:47.678512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:47.679447 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:47.685405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.685862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.687160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.687600 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.717091 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c4f82a76-ee48-474d-94b7-fbe39ed512ac tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042379 Jun 20 06:21:47.717806 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 812/1157] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:21:47 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:21:47.773997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:47.774497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:47.780428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.780915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.781707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.782141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.805810 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:21:47.879217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f70a3c1a-e32f-402f-ac7d-8912f360d2ff tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 204 len: 0 microversion: 2.1 time: 0.108578 Jun 20 06:21:47.879730 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 813/1158] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:47 2022] DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:21:47.888427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:47.889287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:47.896046 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.896509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:47.897353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:47.897800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:48.028825 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:48.036362 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-097bff00-2356-41b2-990c-165da084fef4 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1674 microversion: 2.1 time: 0.152256 Jun 20 06:21:48.036973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 814/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:47 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:49.053965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:49.054594 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:49.061045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:49.061546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:49.062351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:49.062768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:49.192266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:49.199628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a7e7b9fd-5ee6-4eda-b6f9-3a80a1f49155 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1674 microversion: 2.1 time: 0.149661 Jun 20 06:21:49.200191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 815/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:49 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1674 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:50.216537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:50.217232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:50.224424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:50.224924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:50.225699 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:50.226146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:50.439830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:50.447747 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2063f251-bf0e-4af0-9fd6-45c05665d610 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1674 microversion: 2.1 time: 0.235188 Jun 20 06:21:50.448523 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 816/1161] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:50 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1674 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:51.164746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-f722a1b9-e6d9-4820-8a5c-8324207aa88f req-019a5b13-f694-420d-a6f2-7574cd22284e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "944ce698-6e30-4fc4-b584-5800424ad9ef", "name": "network-vif-deleted", "tag": "72febb40-d841-4a11-9e23-523690c84617"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:21:51.175378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f722a1b9-e6d9-4820-8a5c-8324207aa88f req-019a5b13-f694-420d-a6f2-7574cd22284e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:51.175830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-f722a1b9-e6d9-4820-8a5c-8324207aa88f req-019a5b13-f694-420d-a6f2-7574cd22284e service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:51.189102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-f722a1b9-e6d9-4820-8a5c-8324207aa88f req-019a5b13-f694-420d-a6f2-7574cd22284e service nova] Creating event network-vif-deleted:72febb40-d841-4a11-9e23-523690c84617 for instance 944ce698-6e30-4fc4-b584-5800424ad9ef on hv-cinder-80403 Jun 20 06:21:51.196341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-f722a1b9-e6d9-4820-8a5c-8324207aa88f req-019a5b13-f694-420d-a6f2-7574cd22284e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035162 Jun 20 06:21:51.198130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 817/1162] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:21:51.466051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:51.466732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:51.473999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:51.474477 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:51.475247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:51.475695 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:51.509805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:51.510263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:51.510760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lazy-loading 'fault' on Instance uuid 944ce698-6e30-4fc4-b584-5800424ad9ef {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:21:51.553887 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b511b8f2ba394fa9b276f76a52247184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '873857d11992429d8f3a064665c1fc3e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:21:51.556228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=93,nova_cell1:INSERT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:51.562771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c94860a4-d4d6-4d6b-8c40-8c02a91f7708 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 200 len: 1328 microversion: 2.1 time: 0.100986 Jun 20 06:21:51.563347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 818/1163] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:51 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:21:52.580287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:52.580966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:52.587999 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:52.588452 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:52.589256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:52.589692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:52.603254 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef HTTP/1.1 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:21:52.604922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:52.606914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '944ce698-6e30-4fc4-b584-5800424ad9ef'} Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:52.607867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:52.610370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:52.611751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:52.611751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1d934681-e5f3-4e73-b5b1-2992d40d4781 tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 404 len: 111 microversion: 2.1 time: 0.031111 Jun 20 06:21:52.611751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 819/1164] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:52 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:21:52.615531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1b040b75-13bc-4169-a85e-63c3c8100e6a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '.version_select at 0x7f21f1e02c10>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:52.633136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1b040b75-13bc-4169-a85e-63c3c8100e6a tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717010862" status: 202 len: 0 microversion: 2.1 time: 0.020957 Jun 20 06:21:52.633675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 820/1165] 10.222.0.39 () {58 vars in 1220 bytes} [Mon Jun 20 06:21:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1717010862 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:21:55.488728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:55.489300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:55.491748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:21:55.498060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:55.499269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:55.500139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:55.500693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:55.515862 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef HTTP/1.1 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:21:55.517455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.519022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '944ce698-6e30-4fc4-b584-5800424ad9ef'} Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:55.519924 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.521183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.522395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:55.522395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b07ccdc8-bc0c-4d33-a258-319f3b3235af tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 404 len: 111 microversion: 2.1 time: 0.034044 Jun 20 06:21:55.522395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 821/1166] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:55 2022] DELETE /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:21:55.527347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:55.527953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: 944ce698-6e30-4fc4-b584-5800424ad9ef] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:55.533804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:55.534253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:55.535009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:55.535446 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:55.548895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef HTTP/1.1 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:21:55.550381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.551923 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '944ce698-6e30-4fc4-b584-5800424ad9ef'} Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:55.553608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. Jun 20 06:21:55.555058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:55.556451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance 944ce698-6e30-4fc4-b584-5800424ad9ef could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:55.556451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-00b0f9a2-d18b-4006-93e1-6f4957037a7d tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef" status: 404 len: 111 microversion: 2.1 time: 0.028040 Jun 20 06:21:55.556451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 822/1167] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:55 2022] GET /compute/v2.1/servers/944ce698-6e30-4fc4-b584-5800424ad9ef => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:56.703127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:56.704734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:56.714483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:56.714888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:56.715855 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:56.716452 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:56.732736 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a HTTP/1.1 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:21:56.734700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.736285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'db62494c-25f7-4eab-8c22-5c48182d5a5a'} Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:56.737291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.738859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.740513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:56.740513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-036a14c2-8e8a-47d9-8f22-ce80e5bdb28b tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 404 len: 111 microversion: 2.1 time: 0.037889 Jun 20 06:21:56.740513 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 823/1168] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:21:56 2022] DELETE /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:21:56.744856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:21:56.745472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] [instance: db62494c-25f7-4eab-8c22-5c48182d5a5a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:21:56.752130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:56.752584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:56.753379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:21:56.753818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:21:56.767938 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] HTTP exception thrown: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Request method failure captured: Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a HTTP/1.1 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-H0Nh8NNYsy3csyvF7mr6tB892Yu4O5bTLXr9KilhR4R1ZB5M1J7LhAKOQTLqbCn0Hj_DGSU4mJ6MEzN0l7X75O85wbovBwjMPLX6XcvieCsyob4mZenmpcYk5bqa_3NoHENdMbJJ-17YXO9Vg_QDp-n444C-LT_oB0ubTwzYzA-4 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:21:56.769507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/873857d11992429d8f3a064665c1fc3e"}]}] Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 873857d11992429d8f3a064665c1fc3e Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeTestJSON-330599139 Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b511b8f2ba394fa9b276f76a52247184 Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeTestJSON-330599139-project Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.771095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'db62494c-25f7-4eab-8c22-5c48182d5a5a'} Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:21:56.771915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. Jun 20 06:21:56.773390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:21:56.774752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] Returning 404 to user: Instance db62494c-25f7-4eab-8c22-5c48182d5a5a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:21:56.774752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cfd4527d-e28a-47ee-bbb4-87b2581a542c tempest-AttachVolumeTestJSON-330599139 tempest-AttachVolumeTestJSON-330599139-project] 10.222.0.39 "GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a" status: 404 len: 111 microversion: 2.1 time: 0.029667 Jun 20 06:21:56.774752 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 824/1169] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:21:56 2022] GET /compute/v2.1/servers/db62494c-25f7-4eab-8c22-5c48182d5a5a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:22:01.299654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-61cbf431-87a8-4317-8ffd-99e622156bc3 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Action: 'create', calling method: .version_select at 0x7f21ed0aab80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-986823666", "metadata": {"Type": "work"}}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:01.586211 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-61cbf431-87a8-4317-8ffd-99e622156bc3 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.405507 Jun 20 06:22:01.587111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 825/1170] 10.222.0.39 () {60 vars in 1155 bytes} [Mon Jun 20 06:22:01 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 407 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 20 06:22:01.599741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-855f15a6-4825-40f1-926d-b52fab081b4f tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e5de50>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:01.649186 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-855f15a6-4825-40f1-926d-b52fab081b4f tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.054307 Jun 20 06:22:01.649960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 826/1171] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:01 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:02.663344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d22cc0ea-0e72-4869-801b-1b602ecf4563 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e505e0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:02.713255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d22cc0ea-0e72-4869-801b-1b602ecf4563 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 353 microversion: 2.1 time: 0.054491 Jun 20 06:22:02.713815 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 827/1172] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:02 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:02.724955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3d75d804-01d0-4127-8086-2c322ca299d4 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e4f3a0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:02.770576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3d75d804-01d0-4127-8086-2c322ca299d4 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 353 microversion: 2.1 time: 0.049084 Jun 20 06:22:02.771144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 828/1173] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:02 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 353 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:02.782461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b4629914-daf6-4b27-b07b-f2d6752fa020 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e02040>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:02.841179 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b4629914-daf6-4b27-b07b-f2d6752fa020 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 202 len: 0 microversion: 2.1 time: 0.062695 Jun 20 06:22:02.841744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 829/1174] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:22:02 2022] DELETE /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:22:02.849743 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5b0a9768-404d-4287-86ed-271c954b8f23 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21ed1b0940>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:02.895919 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5b0a9768-404d-4287-86ed-271c954b8f23 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.049631 Jun 20 06:22:02.896539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 830/1175] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:02 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:03.909017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0a7426dd-2283-47ae-ba62-4f1f44787c7b tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e19280>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:03.956589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0a7426dd-2283-47ae-ba62-4f1f44787c7b tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.051957 Jun 20 06:22:03.957195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 831/1176] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:03 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:04.969433 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ca0555a3-05c4-4c01-80d1-6dee3c7e8f99 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e193a0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:05.014666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ca0555a3-05c4-4c01-80d1-6dee3c7e8f99 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.049565 Jun 20 06:22:05.015232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 832/1177] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:04 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:06.027884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-eb329c9d-d797-4623-933d-787daf758c8f tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e4f0d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:06.076466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-eb329c9d-d797-4623-933d-787daf758c8f tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.052961 Jun 20 06:22:06.077155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 833/1178] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:06 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:07.085985 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=7 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:07.086740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=11 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:07.091574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-23b9b629-86e0-4c78-958c-0b4dfd2e920e tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e02f70>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:07.142136 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-23b9b629-86e0-4c78-958c-0b4dfd2e920e tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 200 len: 352 microversion: 2.1 time: 0.056773 Jun 20 06:22:07.142725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 834/1179] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:07 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:08.154965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8552f21-2668-4dde-bf10-1633db40a082 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Calling method '.version_select at 0x7f21f1e990d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:08.182063 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-f8552f21-2668-4dde-bf10-1633db40a082 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] HTTP exception thrown: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8552f21-2668-4dde-bf10-1633db40a082 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Request method failure captured: Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 HTTP/1.1 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBIJqLjIrsRK2Ce4OqU6FhGHypTAQNXNcF3TSluFITxd8ykDjgXTzZTXc1n41MoLGSAPlwqp-XcK0NnIhXh--su0jsLDW13CdtkaNzGS4IPlrVNSikmE6UNEV3_GMdiIU_jFZ8TcLqwRNo9c_xdOcukifKfGIF5fgbUgaoSDfbbEfXk Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 52e3579772e64b209ed7a6dfae27e9a3 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-VolumesGetTestJSON-1145814600 Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:08.184073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_52e3579772e64b209ed7a6dfae27e9a3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/52e3579772e64b209ed7a6dfae27e9a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/52e3579772e64b209ed7a6dfae27e9a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/52e3579772e64b209ed7a6dfae27e9a3"}]}] Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-VolumesGetTestJSON-1145814600 Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 52e3579772e64b209ed7a6dfae27e9a3 Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-VolumesGetTestJSON-1145814600 Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-VolumesGetTestJSON-1145814600-project Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 4bfe042445a640eb9259b532d1a6c6a0 Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-VolumesGetTestJSON-1145814600-project Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '15a1baec-dc95-47bc-9aaa-598f045dba54'} Jun 20 06:22:08.185665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. (HTTP 404) (Request-ID: req-5b2be9ee-6fbb-4992-bf0b-bfcc47a358b2) Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:08.186721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 20 06:22:08.188130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 20 06:22:08.189741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f8552f21-2668-4dde-bf10-1633db40a082 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] Returning 404 to user: Volume 15a1baec-dc95-47bc-9aaa-598f045dba54 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f8552f21-2668-4dde-bf10-1633db40a082 tempest-VolumesGetTestJSON-1145814600 tempest-VolumesGetTestJSON-1145814600-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54" status: 404 len: 109 microversion: 2.1 time: 0.034983 Jun 20 06:22:08.191127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 835/1180] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:08 2022] GET /compute/v2.1/os-volumes/15a1baec-dc95-47bc-9aaa-598f045dba54 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:08.649580 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1749749449", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1814282609", "security_groups": [{"name": "tempest-secgroup-smoke-1167724178"}], "block_device_mapping_v2": [{"uuid": "86a3f5ca-e51c-4847-84fc-53fa8ff99b6f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "f55a963e-b480-49e6-9783-3876a7922a09"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:08.762846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] validate_networks() for [('f55a963e-b480-49e6-9783-3876a7922a09', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:22:09.286495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:22:09.287111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:22:09.287358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:22:09.287766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:22:09.288193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:22:09.297671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:09.298132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:09.298975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:09.299418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:09.321371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:22:09.325632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Getting quotas for user b19967e2b09342e9ac006151002bf71a and project 7bcde2f2809247979837902b91d6a6cb. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:22:09.387444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:22:09.389576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86a3f5ca-e51c-4847-84fc-53fa8ff99b6f',volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:22:09.533705 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-762da2c0-9cf1-4d57-aa5a-9270e1cc1016 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.888539 Jun 20 06:22:09.540667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 836/1181] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:22:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:22:09.545829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-35753c9b-1e34-4778-9729-42fc7d8d2a36 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:09.546537 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-35753c9b-1e34-4778-9729-42fc7d8d2a36 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:09.602025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35753c9b-1e34-4778-9729-42fc7d8d2a36 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:09.609780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-35753c9b-1e34-4778-9729-42fc7d8d2a36 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1095 microversion: 2.1 time: 0.067825 Jun 20 06:22:09.610755 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 837/1182] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:09 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:10.626944 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:10.627619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:10.634565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:10.635028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:10.635799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:10.636244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:10.711390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:10.719859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4d5882d6-9f41-4af7-8cb4-3128886485b8 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1201 microversion: 2.1 time: 0.096799 Jun 20 06:22:10.720962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 838/1183] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:10 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1201 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:11.010886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-62b83320-3bbf-4c01-8e85-e35c5466ef7e tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1e4b3a0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:11.059543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-62b83320-3bbf-4c01-8e85-e35c5466ef7e tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/49f89632-c38f-4125-8c96-a6de96b8988e" status: 200 len: 350 microversion: 2.1 time: 0.052371 Jun 20 06:22:11.060151 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 839/1184] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:11 2022] GET /compute/v2.1/os-volumes/49f89632-c38f-4125-8c96-a6de96b8988e => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:11.740011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:11.740618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:11.746907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:11.747366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:11.748145 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:11.748593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:11.951856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:11.960543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7f6df0df-080f-470f-a89f-30750dd01456 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1279 microversion: 2.1 time: 0.226919 Jun 20 06:22:11.961160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 840/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:11 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1279 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:12.413742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-5d2a1211-4755-4ce2-a42e-034207d1ec5a req-4355b6b7-eb3f-46b3-bb97-9ee9ea58ed07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9050c7ed-c955-4eb3-baf3-c408600adf98", "tag": "0b583502-8f47-464f-a231-fd2eb96ecc1e"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:12.431074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5d2a1211-4755-4ce2-a42e-034207d1ec5a req-4355b6b7-eb3f-46b3-bb97-9ee9ea58ed07 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:12.431529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-5d2a1211-4755-4ce2-a42e-034207d1ec5a req-4355b6b7-eb3f-46b3-bb97-9ee9ea58ed07 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:12.448770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-5d2a1211-4755-4ce2-a42e-034207d1ec5a req-4355b6b7-eb3f-46b3-bb97-9ee9ea58ed07 service nova] Creating event network-changed:0b583502-8f47-464f-a231-fd2eb96ecc1e for instance 9050c7ed-c955-4eb3-baf3-c408600adf98 on hv-cinder-80403 Jun 20 06:22:12.453843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-5d2a1211-4755-4ce2-a42e-034207d1ec5a req-4355b6b7-eb3f-46b3-bb97-9ee9ea58ed07 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.196071 Jun 20 06:22:12.455032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 841/1186] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:12.460793 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-382a749b-1b9d-4218-89b0-5203c4cee780 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1de5310>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:12.508637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-382a749b-1b9d-4218-89b0-5203c4cee780 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/0d0a2ae1-b8f4-4f75-bc41-2ba66489663c" status: 200 len: 351 microversion: 2.1 time: 0.052002 Jun 20 06:22:12.509884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 842/1187] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:12 2022] GET /compute/v2.1/os-volumes/0d0a2ae1-b8f4-4f75-bc41-2ba66489663c => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:12.978056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:12.978790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:12.985690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:12.986150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:12.986907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:12.987347 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:13.118068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:13.125548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c7702348-c794-4820-859c-81685aae0c9b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.152097 Jun 20 06:22:13.126108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 843/1188] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:12 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:13.844966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e78c1a12-afb1-455b-8712-ec6cbc9366e5 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1de54c0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:13.894126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e78c1a12-afb1-455b-8712-ec6cbc9366e5 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/7eea919a-6227-4caf-bbff-3f286e0d9564" status: 200 len: 351 microversion: 2.1 time: 0.052916 Jun 20 06:22:13.894697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 844/1189] 10.222.0.39 () {58 vars in 1244 bytes} [Mon Jun 20 06:22:13 2022] GET /compute/v2.1/os-volumes/7eea919a-6227-4caf-bbff-3f286e0d9564 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:13.905511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fd20c5e7-7ebd-4f19-bfb5-9d586aa78774 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21eeb930d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:13.986366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fd20c5e7-7ebd-4f19-bfb5-9d586aa78774 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084341 Jun 20 06:22:13.987089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 845/1190] 10.222.0.39 () {58 vars in 1133 bytes} [Mon Jun 20 06:22:13 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:13.998680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c1083b53-2d58-4c9f-bd90-eafdd646d620 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1e1c160>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.082427 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c1083b53-2d58-4c9f-bd90-eafdd646d620 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087239 Jun 20 06:22:14.083216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 846/1191] 10.222.0.39 () {58 vars in 1148 bytes} [Mon Jun 20 06:22:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:14.095224 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-20ca4fcf-00c3-4363-947c-ae83d1179df5 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1e90dc0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.181949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-20ca4fcf-00c3-4363-947c-ae83d1179df5 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090391 Jun 20 06:22:14.182520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 847/1192] 10.222.0.39 () {58 vars in 1133 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:14.194163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.194771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:14.201005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:14.201462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:14.202237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:14.202676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:14.649008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:14.656574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3031703c-a23b-44e1-b74d-7a4b503e7a33 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.466977 Jun 20 06:22:14.657156 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 848/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:14.662453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b839f8e3-6604-4fcc-8d65-b016b1c38a97 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1de5280>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.743393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b839f8e3-6604-4fcc-8d65-b016b1c38a97 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.085170 Jun 20 06:22:14.743957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 849/1194] 10.222.0.39 () {58 vars in 1166 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:14.754961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f7b6e23e-2af8-4499-8569-08b80cf35421 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1e4b9d0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.833921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f7b6e23e-2af8-4499-8569-08b80cf35421 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.082310 Jun 20 06:22:14.834483 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 850/1195] 10.222.0.39 () {58 vars in 1169 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:14.845891 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-02dff00e-3ae8-450c-b88a-cadae36985ff tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21eeb51670>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:14.927401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-02dff00e-3ae8-450c-b88a-cadae36985ff tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084292 Jun 20 06:22:14.928035 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 851/1196] 10.222.0.39 () {58 vars in 1154 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:14.938618 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-86b074d1-172b-4d0a-8f6e-825327bddfb7 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21eeb51940>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:15.168807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-86b074d1-172b-4d0a-8f6e-825327bddfb7 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.233557 Jun 20 06:22:15.169549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 852/1197] 10.222.0.39 () {58 vars in 1187 bytes} [Mon Jun 20 06:22:14 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:15.180997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e03e2815-58f0-4bc5-8a80-d1b8907915c7 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] Calling method '.version_select at 0x7f21f1de5790>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:15.261997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e03e2815-58f0-4bc5-8a80-d1b8907915c7 tempest-VolumesTestJSON-1283870342 tempest-VolumesTestJSON-1283870342-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084463 Jun 20 06:22:15.262585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 853/1198] 10.222.0.39 () {58 vars in 1154 bytes} [Mon Jun 20 06:22:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:15.673800 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:15.675100 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:15.683306 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:15.683759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:15.684527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:15.684995 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:15.828388 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:15.836589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-68780f2c-cd6f-4486-8814-1f31b0eb0ee4 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.166738 Jun 20 06:22:15.837323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 854/1199] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:15 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:16.853405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:16.854152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:16.861708 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:16.862172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:16.862951 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:16.863401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:16.991987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:16.999500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-646ad099-1eeb-436c-977c-06d43b5ebdc1 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.150045 Jun 20 06:22:17.000062 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 855/1200] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:16 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:18.015560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:18.016220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:18.023327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:18.023774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:18.024534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:18.025005 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:18.152266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:18.159693 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e8ae8516-ab33-4eae-bfd6-8d04025628b9 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.148205 Jun 20 06:22:18.160261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 856/1201] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:18 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:19.177444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:19.178227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:19.184802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:19.185268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:19.186056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:19.186504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:19.310593 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:19.322661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:19.330241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f3c1cda9-abbb-4a7c-ae46-666414287fe7 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.156685 Jun 20 06:22:19.330809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 857/1202] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:19 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:20.347552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:20.348266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:20.350047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=8 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:20.356624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:20.357309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:20.358316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:20.359366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:20.592775 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:20.601118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-32f7bd27-45de-46e6-909b-8061ec3fbd62 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.257170 Jun 20 06:22:20.601889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 858/1203] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:20 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:21.619227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:21.619912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:21.626326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:21.626781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:21.627559 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:21.628006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:21.803392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:21.811301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6098e0ac-e705-44b2-bce4-3e35d05d0860 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.196946 Jun 20 06:22:21.811865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 859/1204] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:21 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:22.828250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:22.828902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:22.835421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:22.835940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:22.836646 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:22.837112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:22.978834 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:22.986611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-81e94e11-1f87-4623-b555-6d48dfbd8c0a tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.162132 Jun 20 06:22:22.987176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 860/1205] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:22 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:24.004028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:24.005079 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:24.013271 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:24.013723 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:24.014491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:24.014929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:24.155769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:24.163843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9bcfef3a-7410-4a03-a5cd-d28e258c4484 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.164283 Jun 20 06:22:24.164426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 861/1206] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:23 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:25.221859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-bc12d4aa-41ae-435e-88b1-3f22695c55f9 req-d0555a24-5db8-4c38-84a6-04aa432941ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9050c7ed-c955-4eb3-baf3-c408600adf98", "name": "network-vif-plugged", "status": "completed", "tag": "0b583502-8f47-464f-a231-fd2eb96ecc1e"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:25.236305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-bc12d4aa-41ae-435e-88b1-3f22695c55f9 req-d0555a24-5db8-4c38-84a6-04aa432941ba service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:25.236792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-bc12d4aa-41ae-435e-88b1-3f22695c55f9 req-d0555a24-5db8-4c38-84a6-04aa432941ba service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:25.249133 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-bc12d4aa-41ae-435e-88b1-3f22695c55f9 req-d0555a24-5db8-4c38-84a6-04aa432941ba service nova] Creating event network-vif-plugged:0b583502-8f47-464f-a231-fd2eb96ecc1e for instance 9050c7ed-c955-4eb3-baf3-c408600adf98 on hv-cinder-80403 Jun 20 06:22:25.254879 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-bc12d4aa-41ae-435e-88b1-3f22695c55f9 req-d0555a24-5db8-4c38-84a6-04aa432941ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.162298 Jun 20 06:22:25.256217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 862/1207] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:25.262972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:25.262972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:25.268792 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:25.269252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:25.270025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:25.270455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:25.413814 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:25.424636 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a05ce0f1-b074-4043-aa76-8300ca514a80 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.166462 Jun 20 06:22:25.425259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 863/1208] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:25 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:25.892239 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:25.892684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:25.899193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:25.899641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:25.900403 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:25.900870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:25.923854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cf8b6123-df1a-466a-bec4-f29401f4a67d tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/ips" status: 200 len: 150 microversion: 2.1 time: 0.035480 Jun 20 06:22:25.924548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 864/1209] 10.222.0.39 () {58 vars in 1247 bytes} [Mon Jun 20 06:22:25 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:26.445407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:26.446040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:26.452532 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:26.453024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:26.453808 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:26.454256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:26.588185 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:26.595579 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c89c7485-e9cf-455c-af99-ecbc734e8463 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1267 microversion: 2.1 time: 0.154301 Jun 20 06:22:26.596143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 865/1210] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:26 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:27.243184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d55451ce-0daf-4a5c-9e6e-2c70941ebddf"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:27.244339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:27.250491 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:27.250982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:27.251826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:27.252346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:27.336511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:28.139253 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5a32f710-c124-4932-b578-0baa1abba833 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "POST /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901098 Jun 20 06:22:28.139895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 866/1211] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:22:27 2022] POST /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:22:28.156690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:28.157529 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:28.169317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:28.170182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:28.171049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:28.171506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:28.333586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:28.341405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f004dcb5-4975-4d6d-903f-838f0ae28492 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1454 microversion: 2.1 time: 0.200392 Jun 20 06:22:28.341987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 867/1212] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:28 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:28.358585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:28.359738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:28.367498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:28.367848 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:28.368630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:28.369098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:28.520465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:28.528799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-307d83f2-e257-45db-81db-232bf38acc58 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1454 microversion: 2.1 time: 0.175001 Jun 20 06:22:28.529678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 868/1213] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:28 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1454 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:30.547845 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-e3ab1efb-4bb4-4de2-a385-e63be59944b3 req-da090d94-e462-4bac-8ba6-218e48cbffa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9050c7ed-c955-4eb3-baf3-c408600adf98", "tag": "0b583502-8f47-464f-a231-fd2eb96ecc1e"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:30.560620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e3ab1efb-4bb4-4de2-a385-e63be59944b3 req-da090d94-e462-4bac-8ba6-218e48cbffa7 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:30.561444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-e3ab1efb-4bb4-4de2-a385-e63be59944b3 req-da090d94-e462-4bac-8ba6-218e48cbffa7 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:30.579441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-e3ab1efb-4bb4-4de2-a385-e63be59944b3 req-da090d94-e462-4bac-8ba6-218e48cbffa7 service nova] Creating event network-changed:0b583502-8f47-464f-a231-fd2eb96ecc1e for instance 9050c7ed-c955-4eb3-baf3-c408600adf98 on hv-cinder-80403 Jun 20 06:22:30.584570 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-e3ab1efb-4bb4-4de2-a385-e63be59944b3 req-da090d94-e462-4bac-8ba6-218e48cbffa7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041141 Jun 20 06:22:30.585213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 869/1214] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:35.922123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:35.922812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:35.929849 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:35.930310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:35.931069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:35.931506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.013119 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lazy-loading 'services' on Instance uuid 90eeea79-d68d-4847-99c8-a74a5db5c356 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:22:36.093112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9909f6ca-cbdf-47dc-bcf4-289c68aa5c25 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments/d55451ce-0daf-4a5c-9e6e-2c70941ebddf" status: 202 len: 0 microversion: 2.1 time: 0.175598 Jun 20 06:22:36.093904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 870/1215] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:22:35 2022] DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments/d55451ce-0daf-4a5c-9e6e-2c70941ebddf => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:22:36.103487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:36.104582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:36.111780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.112251 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.113070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:36.114163 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:36.146321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6acde90c-6f8a-492e-8a83-4cd29806d6cb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046978 Jun 20 06:22:36.147008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 871/1216] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:22:36 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:37.157709 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:37.158641 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:37.161037 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:37.167042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:37.167500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:37.168273 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:37.168741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:37.199816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8e995c27-8264-4bca-88d7-113bd9bda2ac tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045972 Jun 20 06:22:37.200668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 872/1217] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:22:37 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:38.212121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:38.213070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:38.219486 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.219940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.220713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.221155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.250565 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7cc90baf-6bfb-4d64-9383-c93249626e42 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042916 Jun 20 06:22:38.251039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 873/1218] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:22:38 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:22:38.311612 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:38.312113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:38.318905 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.319354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.320192 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.320627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.352029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:22:38.423394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b7f92c29-bb0e-4c0a-8888-ff5a1053fe12 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 204 len: 0 microversion: 2.1 time: 0.115244 Jun 20 06:22:38.424016 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 874/1219] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:22:38 2022] DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:22:38.432688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:38.433407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:38.439159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.439610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.440365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:38.440836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:38.573465 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:38.581077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fd1a8f5f-53a6-4804-bf6a-170fd87141d4 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.152481 Jun 20 06:22:38.581643 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 875/1220] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:38 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:39.604399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:39.604399 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:39.609470 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:39.610949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:39.611741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:39.612190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:39.772685 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:39.781137 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1e5c1f0d-d893-4fbc-8b99-38d57f0bbeb9 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.185390 Jun 20 06:22:39.781712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 876/1221] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:39 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:40.799450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:40.800085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:40.807546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.807993 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.808771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:40.809227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:40.938607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:40.946317 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b096c75-373f-4286-b2b7-ac35ab6fe1b3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.150783 Jun 20 06:22:40.946896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 877/1222] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:40 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:41.964001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:41.964617 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:41.971289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:41.971740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:41.972499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:41.972962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:42.103283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:42.110948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2c30d3d6-07f8-4968-ad50-6ac792e4c9b0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.150824 Jun 20 06:22:42.111543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 878/1223] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:41 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:43.128096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:43.128786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:43.135480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:43.135942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:43.136728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:43.137191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:43.265083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:43.272592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bd3ca792-bb16-488b-a477-6a89ec626a70 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.148429 Jun 20 06:22:43.273190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 879/1224] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:43 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:44.289672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:44.290325 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:44.296986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:44.297441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:44.298228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:44.298666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:44.319607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:22:44.435888 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:44.443546 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-52f93c99-e34f-45e2-abe4-718219f5ae49 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.157745 Jun 20 06:22:44.444111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 880/1225] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:44 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:22:45.462178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:45.463064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:45.469686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:45.470218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:45.471112 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:45.471630 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:45.662404 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '68c4b81f2f704a9bbe15fd0f3326bb3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adba1d74cb2441a9a238dc0e6a47c112', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:22:45.672790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5033c216-bb26-4eb4-b929-5d10b6e470bf tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 200 len: 1682 microversion: 2.1 time: 0.215791 Jun 20 06:22:45.673975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 881/1226] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:45 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 1682 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:22:45.970759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-610e25f0-fea7-4d11-8ba5-504a64277ccc req-33f04f34-af53-497d-9094-7a73a57d2959 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90eeea79-d68d-4847-99c8-a74a5db5c356", "name": "network-vif-deleted", "tag": "5b2deef5-f052-4897-9d09-85729b149be7"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:22:45.980940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-610e25f0-fea7-4d11-8ba5-504a64277ccc req-33f04f34-af53-497d-9094-7a73a57d2959 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:45.981757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-610e25f0-fea7-4d11-8ba5-504a64277ccc req-33f04f34-af53-497d-9094-7a73a57d2959 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:45.994055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-610e25f0-fea7-4d11-8ba5-504a64277ccc req-33f04f34-af53-497d-9094-7a73a57d2959 service nova] Creating event network-vif-deleted:5b2deef5-f052-4897-9d09-85729b149be7 for instance 90eeea79-d68d-4847-99c8-a74a5db5c356 on hv-cinder-80403 Jun 20 06:22:45.999534 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-610e25f0-fea7-4d11-8ba5-504a64277ccc req-33f04f34-af53-497d-9094-7a73a57d2959 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032357 Jun 20 06:22:46.000803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 882/1227] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:22:46.691920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:46.692660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:46.699591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:46.700052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:46.700874 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:46.701323 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:46.715316 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 HTTP/1.1 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:46.717321 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:46.718945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '90eeea79-d68d-4847-99c8-a74a5db5c356'} Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:46.719770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:46.721111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:46.723194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:46.723194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b22967c9-9765-44e9-8164-f45d6c6602e0 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 404 len: 111 microversion: 2.1 time: 0.031661 Jun 20 06:22:46.723194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 883/1228] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:46 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:46.728013 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9f324cc1-9d31-4d00-9233-535be3e3e0fb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '.version_select at 0x7f21ed09f670>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:46.746662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9f324cc1-9d31-4d00-9233-535be3e3e0fb tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997389621" status: 202 len: 0 microversion: 2.1 time: 0.022738 Jun 20 06:22:46.747228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 884/1229] 10.222.0.39 () {58 vars in 1220 bytes} [Mon Jun 20 06:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1997389621 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:22:48.515396 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:48.516056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:48.523503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.523970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.524861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.525363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 HTTP/1.1 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:48.547217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.549022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '90eeea79-d68d-4847-99c8-a74a5db5c356'} Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:48.549927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.551353 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.553592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:48.553592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-58a7cacf-404b-403e-8f2e-1723faedce80 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 404 len: 111 microversion: 2.1 time: 0.036077 Jun 20 06:22:48.553592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 885/1230] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:22:48 2022] DELETE /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:22:48.556865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:48.557500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 90eeea79-d68d-4847-99c8-a74a5db5c356] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:48.563308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.563765 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.564558 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:48.565029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:48.578590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 HTTP/1.1 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:48.580088 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.581718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '90eeea79-d68d-4847-99c8-a74a5db5c356'} Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:48.582549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. Jun 20 06:22:48.584893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:48.586232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 90eeea79-d68d-4847-99c8-a74a5db5c356 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:48.586232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-770474f1-8de3-4d04-b5c2-07cc82604f1a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356" status: 404 len: 111 microversion: 2.1 time: 0.029447 Jun 20 06:22:48.586232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 886/1231] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:48 2022] GET /compute/v2.1/servers/90eeea79-d68d-4847-99c8-a74a5db5c356 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:49.713564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.714209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.720943 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.721489 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.722490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.722933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.737049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 HTTP/1.1 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:49.738591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.740391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'd66b01e5-b7b8-4259-8fc4-88aafb3a66b8'} Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:49.741697 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.743218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.744883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:49.744883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a02c7a02-a40d-48b2-9761-bf43498bf982 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 404 len: 111 microversion: 2.1 time: 0.030392 Jun 20 06:22:49.744883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 887/1232] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:22:49 2022] DELETE /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:22:49.748023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.748627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: d66b01e5-b7b8-4259-8fc4-88aafb3a66b8] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.754440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.754892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.756472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.756946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.773190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 HTTP/1.1 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:49.774756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.776397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'd66b01e5-b7b8-4259-8fc4-88aafb3a66b8'} Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:49.777344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. Jun 20 06:22:49.778729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.779946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:49.779946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-920a010e-ac19-44fc-97f4-e56e33d9fbff tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8" status: 404 len: 111 microversion: 2.1 time: 0.031628 Jun 20 06:22:49.779946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 888/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:49 2022] GET /compute/v2.1/servers/d66b01e5-b7b8-4259-8fc4-88aafb3a66b8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:49.786674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.787227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.793057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.793506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.794263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.794698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.807628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 HTTP/1.1 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:49.809180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.810783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '0d58d309-e139-4ba1-bfbb-3eb6374de542'} Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:49.811627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.813340 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.815077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:49.815077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-52a99251-df09-4d7a-8aa7-d2edb7ff026a tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 404 len: 111 microversion: 2.1 time: 0.028280 Jun 20 06:22:49.815077 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 889/1234] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:22:49 2022] DELETE /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:49.819402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:49.820011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: 0d58d309-e139-4ba1-bfbb-3eb6374de542] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:49.826001 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.826455 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.827220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:49.827660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:49.841237 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 HTTP/1.1 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:49.842776 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.844339 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '0d58d309-e139-4ba1-bfbb-3eb6374de542'} Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:49.845293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. Jun 20 06:22:49.846759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:49.848401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance 0d58d309-e139-4ba1-bfbb-3eb6374de542 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:49.848401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-44079032-5a82-4b57-a59a-18ce906395e3 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542" status: 404 len: 111 microversion: 2.1 time: 0.029123 Jun 20 06:22:49.848799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 890/1235] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:49 2022] GET /compute/v2.1/servers/0d58d309-e139-4ba1-bfbb-3eb6374de542 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:22:50.997115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:50.997757 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:51.007269 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.007732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.008526 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.010135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.026574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 HTTP/1.1 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:51.028153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.029854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'c0338365-19aa-44e3-bf8b-fa704eb7ce10'} Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:51.030794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.032295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.033867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:51.033867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2979a4a4-0eee-47ea-a8a1-037bd630cf7e tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 404 len: 111 microversion: 2.1 time: 0.036867 Jun 20 06:22:51.033867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 891/1236] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:22:50 2022] DELETE /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:51.038661 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:22:51.039521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] [instance: c0338365-19aa-44e3-bf8b-fa704eb7ce10] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:22:51.045886 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.046344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.047174 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:22:51.047656 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:22:51.062354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] HTTP exception thrown: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Request method failure captured: Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 HTTP/1.1 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-MZdXHnePq-J-w6SxQQ3-K78D4TfCkjo3WP405QW-oecT6Cgb5dzDSgBOvAs4_G9ovC9_4wm6omwF9BRItlP2uNWY--bIpMS9NpmbPgVlYet2qqgyx3buNzFcpzh1-W8sCeV5JnGKuYoW_DiTN4GlpJzq65pl3c6kufGdR42MWPgA Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:22:51.063915 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/adba1d74cb2441a9a238dc0e6a47c112"}]}] Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: adba1d74cb2441a9a238dc0e6a47c112 Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-272109794 Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 68c4b81f2f704a9bbe15fd0f3326bb3e Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeNegativeTest-272109794-project Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.065651 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'c0338365-19aa-44e3-bf8b-fa704eb7ce10'} Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:22:51.066505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. Jun 20 06:22:51.067902 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:22:51.069021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] Returning 404 to user: Instance c0338365-19aa-44e3-bf8b-fa704eb7ce10 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:22:51.069021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5ab164a1-5ba2-44d3-883d-40a85fbacd20 tempest-AttachVolumeNegativeTest-272109794 tempest-AttachVolumeNegativeTest-272109794-project] 10.222.0.39 "GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10" status: 404 len: 111 microversion: 2.1 time: 0.031170 Jun 20 06:22:51.069021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 892/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:22:51 2022] GET /compute/v2.1/servers/c0338365-19aa-44e3-bf8b-fa704eb7ce10 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:22:59.218528 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:22:59.219055 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:22:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:23:06.963552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:06.964512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:06.967172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:06.967979 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=28 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:06.974804 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:06.975261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:06.976032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:06.976476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.006957 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-56105b3d-1aad-4e68-9fc9-0a329ecd5c01 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047406 Jun 20 06:23:07.007512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 893/1238] 10.222.0.39 () {60 vars in 1342 bytes} [Mon Jun 20 06:23:06 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:07.063669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:07.064182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:07.070430 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.070889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.071662 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.072106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.096120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:23:07.174407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2e8d82fc-7327-465a-afcc-253a64fff7fd tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 204 len: 0 microversion: 2.20 time: 0.114400 Jun 20 06:23:07.175301 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 894/1239] 10.222.0.39 () {60 vars in 1279 bytes} [Mon Jun 20 06:23:07 2022] DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 06:23:07.184223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:07.184959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:07.190782 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.191259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.192004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:07.192450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:07.323781 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:07.331680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:07.334298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:07.335484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9af12a47-36c0-40b9-af87-ac18dcdf9962 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.155381 Jun 20 06:23:07.336047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 895/1240] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:07 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:23:08.353462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:08.354193 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:08.361760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:08.362278 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:08.363272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:08.364145 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:08.500207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:08.509540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:08.511382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:08.512638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b9f87104-f145-4c23-bbcd-747dcffebb69 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.163134 Jun 20 06:23:08.513226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 896/1241] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:08 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:23:09.533244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:09.533937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:09.540334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:09.540824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:09.541595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:09.542033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:09.770081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:09.778463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:09.780203 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:09.781450 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-be6a6ba1-d83f-4f79-bc40-f745f0332e4e tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1725 microversion: 2.20 time: 0.252122 Jun 20 06:23:09.782034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 897/1242] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:09 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1725 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 20 06:23:10.322256 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-3ddae0c5-9d40-48dc-8880-d117af84131f req-bc582876-6343-4fa8-8477-56be56ea9152 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce81df8-2c3a-441f-a1ae-2977c58fecc3", "name": "network-vif-deleted", "tag": "0f458327-eb14-40a2-a4cd-e54e726bd3eb"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:23:10.331472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-3ddae0c5-9d40-48dc-8880-d117af84131f req-bc582876-6343-4fa8-8477-56be56ea9152 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:10.331998 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-3ddae0c5-9d40-48dc-8880-d117af84131f req-bc582876-6343-4fa8-8477-56be56ea9152 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:10.347288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-3ddae0c5-9d40-48dc-8880-d117af84131f req-bc582876-6343-4fa8-8477-56be56ea9152 service nova] Creating event network-vif-deleted:0f458327-eb14-40a2-a4cd-e54e726bd3eb for instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 on hv-cinder-80403 Jun 20 06:23:10.356009 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-3ddae0c5-9d40-48dc-8880-d117af84131f req-bc582876-6343-4fa8-8477-56be56ea9152 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037611 Jun 20 06:23:10.357448 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 898/1243] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:23:10.800428 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:10.801173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:10.808304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:10.808794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:10.809571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:10.810019 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:10.853738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:10.854521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:10.855488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lazy-loading 'fault' on Instance uuid fce81df8-2c3a-441f-a1ae-2977c58fecc3 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:23:10.906407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:10.915700 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:10.917531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '498822fcffaf4cc79532c487418cb11c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b2cb11b20af48f8b0e9f0a4cf1b9406', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:10.918917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-285094ce-9901-4af9-8cff-ef5445ffc200 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 200 len: 1371 microversion: 2.20 time: 0.123267 Jun 20 06:23:10.919677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 899/1244] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:10 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 1371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 20 06:23:11.938143 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:11.938771 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:11.945095 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:11.945552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:11.946311 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:11.946746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:11.960175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 HTTP/1.1 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:23:11.961867 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:11.963660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'fce81df8-2c3a-441f-a1ae-2977c58fecc3'} Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:23:11.964581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:11.966230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:11.967584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:23:11.967584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-efae48cf-3bea-40f1-bd76-8c885287c2e9 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 404 len: 111 microversion: 2.20 time: 0.029085 Jun 20 06:23:11.967584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 900/1245] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:11 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:23:11.971419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f66995c3-8ce7-42f4-9483-7b2aeffef6fc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '.version_select at 0x7f21ed0cb160>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:11.989606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f66995c3-8ce7-42f4-9483-7b2aeffef6fc tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565036112" status: 204 len: 0 microversion: 2.20 time: 0.021569 Jun 20 06:23:11.990208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 901/1246] 10.222.0.39 () {60 vars in 1261 bytes} [Mon Jun 20 06:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1565036112 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 20 06:23:14.006520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:14.007109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:14.013851 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.014310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.015081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.015521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.030795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 HTTP/1.1 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:23:14.032382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.034162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'fce81df8-2c3a-441f-a1ae-2977c58fecc3'} Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:23:14.035514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.036875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.038970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:23:14.038970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-13746d53-748d-4896-8401-4333abb65cf7 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 404 len: 111 microversion: 2.20 time: 0.032045 Jun 20 06:23:14.038970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 902/1247] 10.222.0.39 () {60 vars in 1279 bytes} [Mon Jun 20 06:23:14 2022] DELETE /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:23:14.042799 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:14.043473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: fce81df8-2c3a-441f-a1ae-2977c58fecc3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:14.049472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.049997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.050885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:14.051463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:14.064836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 HTTP/1.1 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:23:14.066363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.068082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': 'fce81df8-2c3a-441f-a1ae-2977c58fecc3'} Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:23:14.069259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. Jun 20 06:23:14.070539 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:14.072168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance fce81df8-2c3a-441f-a1ae-2977c58fecc3 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:23:14.072168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fc3a0a58-a7a5-4472-989c-ccbe41f43506 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3" status: 404 len: 111 microversion: 2.20 time: 0.028810 Jun 20 06:23:14.072168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 903/1248] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:14 2022] GET /compute/v2.1/servers/fce81df8-2c3a-441f-a1ae-2977c58fecc3 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:23:15.209204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:15.210227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:15.216259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.216744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.217515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.217962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.233489 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 HTTP/1.1 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:23:15.233852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.235548 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '7a94bb25-2c14-43f3-91a3-1f75da735166'} Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:23:15.236384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.237667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.238926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:23:15.238926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-530ef2dd-7657-4c42-a4cf-cac46fcb3422 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 404 len: 111 microversion: 2.20 time: 0.029902 Jun 20 06:23:15.238926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 904/1249] 10.222.0.39 () {60 vars in 1279 bytes} [Mon Jun 20 06:23:15 2022] DELETE /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 20 06:23:15.244155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:15.244802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] [instance: 7a94bb25-2c14-43f3-91a3-1f75da735166] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:15.251094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.251411 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.252334 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:15.252627 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] HTTP exception thrown: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Request method failure captured: Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 HTTP/1.1 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisA-HkHSqeZHXzLWBTY0QjNnI5iXqZa0RkUd0NepmbGxU8elhidL_LQhTy9_-OWkWzCCqlG8SzgjL2o7pn88TSnA4yiidUM-V59Nro8V2OTHcENbFA1-JQx1H0JZlKhtOkCExZ1GmlZl8KZ0w_yj_OfpCDC4psMk213bsECcbtnc1CfI Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Openstack-Nova-Api-Version: 2.20 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:23:15.270039 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/0b2cb11b20af48f8b0e9f0a4cf1b9406"}]}] Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 0b2cb11b20af48f8b0e9f0a4cf1b9406 Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-439766840 Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: 498822fcffaf4cc79532c487418cb11c Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-AttachVolumeShelveTestJSON-439766840-project Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.274164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '7a94bb25-2c14-43f3-91a3-1f75da735166'} Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:23:15.275098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. Jun 20 06:23:15.277865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:23:15.279165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] Returning 404 to user: Instance 7a94bb25-2c14-43f3-91a3-1f75da735166 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:23:15.279165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-653aabc4-b942-4ba7-a9e6-46d3e1940967 tempest-AttachVolumeShelveTestJSON-439766840 tempest-AttachVolumeShelveTestJSON-439766840-project] 10.222.0.39 "GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166" status: 404 len: 111 microversion: 2.20 time: 0.030220 Jun 20 06:23:15.279165 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 905/1250] 10.222.0.39 () {60 vars in 1276 bytes} [Mon Jun 20 06:23:15 2022] GET /compute/v2.1/servers/7a94bb25-2c14-43f3-91a3-1f75da735166 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 20 06:23:44.618694 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fb7946e4-9051-4108-a7c4-477743a62a7e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'create', calling method: .version_select at 0x7f21f1e8d280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1445107466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHww3sRPNO6SopJLWEEn6yt6+N0KIbwCDZV/joTADQ19qc4FhaKSPlASY1qXZbEdVCvHzHPbqAcL/+pTEhAF9OWWkKy/sN6gnruaJULQ23yASTQxQQgAHnwUQWO3CXsiuA=="}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:23:44.622947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:44.623595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:44.639992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-fb7946e4-9051-4108-a7c4-477743a62a7e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Getting quotas for project 205a62429cea49ba80167ac7866639f0. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:23:44.644852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-fb7946e4-9051-4108-a7c4-477743a62a7e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Getting quotas for user c7e9f3f1a65e4204887ee69de7cf2f58 and project 205a62429cea49ba80167ac7866639f0. Resources: {'key_pairs'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:23:44.668213 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fb7946e4-9051-4108-a7c4-477743a62a7e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.053906 Jun 20 06:23:44.668770 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 906/1251] 10.222.0.39 () {60 vars in 1158 bytes} [Mon Jun 20 06:23:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:23:44.822977 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1301141188", "imageRef": "e20403e8-073c-491a-a5cb-e3bd626f6fa3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1445107466", "networks": [{"uuid": "4b479067-3954-479f-9a71-544721a1fa3b"}]}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:23:44.883026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.network.neutron [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] validate_networks() for [('4b479067-3954-479f-9a71-544721a1fa3b', None, None, None, None, None)] {{(pid=117585) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 20 06:23:45.343234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Flavor limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 20 06:23:45.343807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Image limits 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 20 06:23:45.344585 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Flavor pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 20 06:23:45.345370 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Image pref 0:0:0 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 20 06:23:45.345920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.virt.hardware [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117585) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 20 06:23:45.355492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:45.355945 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:45.356789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:45.357242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:45.376606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Getting quotas for project 205a62429cea49ba80167ac7866639f0. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 20 06:23:45.381541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.quota [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Getting quotas for user c7e9f3f1a65e4204887ee69de7cf2f58 and project 205a62429cea49ba80167ac7866639f0. Resources: {'instances', 'cores', 'ram'} {{(pid=117585) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 20 06:23:45.393116 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Going to run 1 instances... {{(pid=117585) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 20 06:23:45.395286 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e20403e8-073c-491a-a5cb-e3bd626f6fa3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117585) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 20 06:23:45.445843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3bc920cb-29c0-495b-b44d-d663bc7c4cad tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.625991 Jun 20 06:23:45.446668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 907/1252] 10.222.0.39 () {60 vars in 1146 bytes} [Mon Jun 20 06:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 20 06:23:45.456525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ba650833-2799-487e-b65a-9e85e3d0ad17 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:45.457463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ba650833-2799-487e-b65a-9e85e3d0ad17 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:45.518110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ba650833-2799-487e-b65a-9e85e3d0ad17 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:45.526333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ba650833-2799-487e-b65a-9e85e3d0ad17 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1259 microversion: 2.1 time: 0.073536 Jun 20 06:23:45.527208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 908/1253] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:45 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1259 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:46.542844 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:46.543629 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:46.550229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:46.550691 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:46.551466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:46.552106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:46.616153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:46.624010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-12c22d40-d03e-4612-adf6-20986d955682 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1263 microversion: 2.1 time: 0.085016 Jun 20 06:23:46.624576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 909/1254] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:46 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1263 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:47.641541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:47.642196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:47.648603 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:47.649089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:47.649846 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:47.650282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:47.710637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:47.717904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e43ac986-9a68-489e-9729-d67c50141221 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1263 microversion: 2.1 time: 0.080237 Jun 20 06:23:47.718462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 910/1255] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:47 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1263 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:48.734522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:48.735152 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:48.742021 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.742473 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.743238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:48.743675 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:48.809015 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:48.816330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f6030b66-cd32-4035-ba83-09c7e1a9d354 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1311 microversion: 2.1 time: 0.085924 Jun 20 06:23:48.816916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 911/1256] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:48 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1311 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:49.841503 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:49.843238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:49.876110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.877006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:49.878488 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:49.880440 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:50.099435 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:50.109096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7b6f86ae-0857-4356-9c61-adccb4ed8ec8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.276998 Jun 20 06:23:50.110421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 912/1257] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:49 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:51.126860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:51.127610 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:51.135195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.135751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.136654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:51.137220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:51.275564 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:51.283051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e2941555-6462-4935-9349-c87513e1f81b tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.160118 Jun 20 06:23:51.283614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 913/1258] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:51 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:52.300444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:52.301279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:52.312422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.312929 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.314007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:52.314452 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:52.532308 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:52.541378 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9857591d-26ae-4f1b-b13e-5d60437cec57 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.244672 Jun 20 06:23:52.542787 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 914/1259] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:52 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:53.559589 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:53.561180 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:53.575921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.576673 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.578178 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:53.578972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:53.796391 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:53.806562 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5a3a20a5-cd9a-41f1-ac84-58e95b75202d tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.250775 Jun 20 06:23:53.807785 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 915/1260] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:53 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:54.826405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:54.827878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:54.840003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.840758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:54.842107 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:54.842557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:55.015713 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:55.025304 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5c3f4986-c4e2-4d3d-9e0c-a917f907544f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.204500 Jun 20 06:23:55.026155 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 916/1261] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:54 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:56.042748 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:56.043346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:56.048987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:56.049901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=12 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:23:56.053843 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:56.054587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:56.056454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:56.057103 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:56.255917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:56.264294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-82e06f14-6b25-44dd-a089-bf11825b712e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.225153 Jun 20 06:23:56.266373 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 917/1262] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:56 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:23:57.281841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:57.282619 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:57.291049 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.291497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.292264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:57.292732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:57.437153 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:57.445704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7acda59a-a638-49f4-83c4-b484522a4fdc tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.167578 Jun 20 06:23:57.446367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 918/1263] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:57 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:58.462431 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:58.463059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:58.469602 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.470064 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.470835 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:58.471284 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:58.611469 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:23:58.621157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-707ce546-3a60-4aa9-b046-ae70fe36932f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.162650 Jun 20 06:23:58.621719 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 919/1264] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:58 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:23:59.639199 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:23:59.640805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:23:59.648913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.649773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:23:59.650809 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:23:59.651344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:00.163607 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:00.181778 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1fc3370d-e404-4620-8922-0e559cc09f9e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.547548 Jun 20 06:24:00.182983 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 920/1265] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:23:59 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:01.199795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:01.200517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:01.207689 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:01.208255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:01.209576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:01.210098 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:01.407055 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:01.424285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f2e72e61-20b5-4328-b273-11c498764d02 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.226327 Jun 20 06:24:01.443490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 921/1266] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:01 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:02.449779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:02.450657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:02.458117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.458625 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.459987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:02.460445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:02.605667 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:02.614175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-24bb0b95-3cb4-4990-b9ee-0682db0bb577 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.177024 Jun 20 06:24:02.615577 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 922/1267] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:02 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:03.632414 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:03.634229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:03.650017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.650017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.650017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:03.650017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:03.785628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:03.793504 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d48b5968-1a80-4350-a9b8-3d20c9443ee1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.165885 Jun 20 06:24:03.794338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 923/1268] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:03 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:04.814127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:04.815820 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:04.825360 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.826029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:04.827000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:04.828105 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:05.094947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:05.103720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-85c7f8c8-d80b-4bc5-bced-8e0985c014c9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.295938 Jun 20 06:24:05.107645 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 924/1269] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:04 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:05.562652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-bc043384-2a69-4fd1-ba70-9b240bea3da9 req-9b70ca8d-84bc-4532-bbef-afc237ff2b95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:05.572426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-bc043384-2a69-4fd1-ba70-9b240bea3da9 req-9b70ca8d-84bc-4532-bbef-afc237ff2b95 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:05.573172 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-bc043384-2a69-4fd1-ba70-9b240bea3da9 req-9b70ca8d-84bc-4532-bbef-afc237ff2b95 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:05.585487 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=100 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:05.597595 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-bc043384-2a69-4fd1-ba70-9b240bea3da9 req-9b70ca8d-84bc-4532-bbef-afc237ff2b95 service nova] Creating event network-changed:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:24:05.608412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-bc043384-2a69-4fd1-ba70-9b240bea3da9 req-9b70ca8d-84bc-4532-bbef-afc237ff2b95 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045708 Jun 20 06:24:05.609884 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 925/1270] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:24:06.124094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:06.125074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:06.133573 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:06.134036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:06.134807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:06.135243 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:06.278892 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:06.287187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a8c6b3c5-0f92-43d4-92c8-cf2d61cad3e9 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.167400 Jun 20 06:24:06.288222 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 926/1271] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:06 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:07.304142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:07.304796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:07.311955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.312409 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.313201 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:07.313644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:07.446692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:07.454318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-b543d7f0-93fd-4767-a304-936f7af65fb1 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.153938 Jun 20 06:24:07.454816 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 927/1272] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:07 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:08.471208 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:08.471832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:08.479012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.479468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.480500 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:08.480970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:08.765744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:08.774262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-724efbc8-6bac-45bd-a459-f71e2814db30 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.306828 Jun 20 06:24:08.774838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 928/1273] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:08 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:09.792349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:09.793074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:09.799591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.800060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.800869 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:09.801397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:09.943351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:09.951082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-33d5d00f-f9e6-45d8-a024-3ed34cb91a96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.162575 Jun 20 06:24:09.951659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 929/1274] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:09 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:10.967779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:10.968387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:10.976515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:10.977028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:10.977794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:10.978234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:11.144099 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:11.155030 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-85dd7f1b-6370-4d35-b6cc-588daf8b4831 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.190476 Jun 20 06:24:11.156650 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 930/1275] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:10 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:12.172536 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:12.173187 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:12.179837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.180292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.181083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.181522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.325841 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:12.337262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3fa10fdc-5be1-403c-941d-a6bd1bf54813 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.168579 Jun 20 06:24:12.346948 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 931/1276] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:12 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:12.510183 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:12.511024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:12.517089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.517750 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.518519 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.518956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.543441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lazy-loading 'flavor' on Instance uuid 692ea93e-f0ec-4dd5-a7af-4e192f859125 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:24:12.626766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f724f0cb-94ff-40fa-902f-5e7e6466c3a8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "POST /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125/action" status: 202 len: 0 microversion: 2.1 time: 0.119998 Jun 20 06:24:12.631453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 932/1277] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:24:12 2022] POST /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125/action => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:24:12.640561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:12.642038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:12.652343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.653085 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.653926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.654679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.867801 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:12.875853 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a3f97975-49f6-4a1b-9037-2b81e4d8f15a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.241682 Jun 20 06:24:12.887074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 933/1278] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:12 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:12.887074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-01b1e2ca-77be-442c-a66d-a4ee43bd688f req-dd26e2a8-66ac-4194-a24a-cae12505678b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "name": "network-vif-plugged", "status": "completed", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:12.891330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-01b1e2ca-77be-442c-a66d-a4ee43bd688f req-dd26e2a8-66ac-4194-a24a-cae12505678b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:12.891850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-01b1e2ca-77be-442c-a66d-a4ee43bd688f req-dd26e2a8-66ac-4194-a24a-cae12505678b service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:12.903877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-01b1e2ca-77be-442c-a66d-a4ee43bd688f req-dd26e2a8-66ac-4194-a24a-cae12505678b service nova] Creating event network-vif-plugged:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:24:12.908986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-01b1e2ca-77be-442c-a66d-a4ee43bd688f req-dd26e2a8-66ac-4194-a24a-cae12505678b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030188 Jun 20 06:24:12.909592 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 934/1279] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:13.360276 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:13.362419 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:13.370953 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.372036 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.373332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.374955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.589515 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:13.598309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-91d9a93d-4db7-44f9-afc0-2232803d27f0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.243508 Jun 20 06:24:13.600561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 935/1280] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:13 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:13.894459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:13.895084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:13.902307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.902789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:13.903727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:13.904355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.074758 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:14.083511 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f1482fe5-c1b8-4007-9db5-3e4b181cdeef tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.193139 Jun 20 06:24:14.084520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 936/1281] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:13 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:14.615281 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:14.616310 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:14.622543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.623082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.623870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:14.624314 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:14.760207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:14.769922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-73f18488-49bc-41e1-b089-3da8c80c9858 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1359 microversion: 2.1 time: 0.158369 Jun 20 06:24:14.771230 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 937/1282] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:14 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:15.106052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:15.106918 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:15.109300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:15.115649 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.116196 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.117080 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.117613 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.263345 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:15.274715 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8be1160b-f9e3-425b-a566-1db489e9131f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.177626 Jun 20 06:24:15.275394 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 938/1283] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:15 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:15.787596 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:15.788348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:15.794717 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.795227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.795994 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.796437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.932819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:15.940493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-dc785f1b-a41e-4aa8-8dc2-2d6e884645bd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1548 microversion: 2.1 time: 0.157154 Jun 20 06:24:15.940932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 939/1284] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:15 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:15.956122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:15.956756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:15.966587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.967418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:15.968803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:15.969614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.109268 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:16.116930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1a4e5f95-7e53-45ca-a2b4-8142af0e3587 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1548 microversion: 2.1 time: 0.164371 Jun 20 06:24:16.117509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 940/1285] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:15 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:16.131987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:16.135418 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:16.136413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Searching by: {'deleted': False, 'project_id': '205a62429cea49ba80167ac7866639f0'} {{(pid=117585) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 20 06:24:16.143084 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.143542 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.144349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.144829 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.215492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:16.237093 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.multi_cell_list [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117585) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 20 06:24:16.341215 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-da627073-83cc-4dc2-b8ab-0244bd4e85ab tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212706 Jun 20 06:24:16.341803 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 941/1286] 10.222.0.39 () {58 vars in 1124 bytes} [Mon Jun 20 06:24:16 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:24:16.352497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:16.353179 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:16.359561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.360025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.361012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.361461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.503480 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:16.511769 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-746991a6-2622-4caa-bcb1-48e52cb2e732 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.169004 Jun 20 06:24:16.512350 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 942/1287] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:16 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:16.516937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:16.517586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:16.524123 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.524586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.525393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:16.525927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:16.673443 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:16.682624 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4ab2d961-79ef-410e-a989-2048e087d952 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1548 microversion: 2.1 time: 0.169188 Jun 20 06:24:16.683405 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 943/1288] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:16 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1548 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:17.529267 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:17.529927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:17.537355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:17.537916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:17.538760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:17.539279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:17.670928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:17.679006 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ab16c530-aedd-4c36-8f6b-f18ebeddbc26 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.153842 Jun 20 06:24:17.679591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 944/1289] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:17 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:18.695318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:18.695936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:18.702303 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:18.702756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:18.703510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:18.703946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:18.853521 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:18.861522 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a34675f7-63e5-4a91-a0fa-9dcd3eb9be97 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.170034 Jun 20 06:24:18.862117 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 945/1290] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:18 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:19.879495 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:19.880240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:19.887490 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:19.887950 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:19.891002 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:19.891741 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:20.050720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:20.060978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d445bbff-fe73-4867-87cb-8a8fdbda6afe tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.185071 Jun 20 06:24:20.061572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 946/1291] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:19 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:21.077823 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:21.078459 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:21.085576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.086026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.086789 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.087225 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.217032 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:21.224601 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-def172fa-01b9-402c-a256-70a9fb419699 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.150634 Jun 20 06:24:21.225252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 947/1292] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:21 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:21.364679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf1a3007-8967-405d-82d6-2716b89ecb0b"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:21.366017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:21.373127 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.373581 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.374422 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:21.375003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:21.654382 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f58d4687-b1d8-4c0f-95cf-aca22f7b26e2 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293490 Jun 20 06:24:21.655008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 948/1293] 10.222.0.39 () {60 vars in 1322 bytes} [Mon Jun 20 06:24:21 2022] POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:24:22.243249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:22.244007 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:22.250458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:22.250910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:22.251898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:22.252341 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:22.393379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:22.405003 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a123145e-1399-4d79-87b2-faabd407c763 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.167019 Jun 20 06:24:22.405894 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 949/1294] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:22 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:23.422044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:23.422707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:23.429896 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:23.430344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:23.431126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:23.431538 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:23.569831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:23.577335 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-de6f1357-009a-4c79-9fec-f50cf18e75ab tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.159180 Jun 20 06:24:23.577910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 950/1295] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:23 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:24.594472 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:24.595069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:24.602204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:24.602666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:24.603439 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:24.603885 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:24.734533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:24.742779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-44966108-4ca4-4b75-b717-88428b4a9402 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.152287 Jun 20 06:24:24.743351 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 951/1296] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:24 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:25.760279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:25.760932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:25.767204 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:25.767655 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:25.768408 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:25.768883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:25.901377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:25.909344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-575dcb91-46e2-47b1-a68b-7f7815fd3a2f tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.153530 Jun 20 06:24:25.909914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 952/1297] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:25 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:26.934677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:26.935318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:26.937258 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell0:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:26.943191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:26.944299 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:26.945380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:26.945921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:27.078852 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:27.087177 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8225629c-1259-471d-85a2-fed6f628f8e6 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.156615 Jun 20 06:24:27.087751 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 953/1298] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:26 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:28.104083 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:28.104766 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:28.111437 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.111895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.112659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:28.113126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:28.258599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:28.266416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-28bd0d56-fbb3-4032-9cd6-ee736ceec65b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.166128 Jun 20 06:24:28.267054 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 954/1299] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:28 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:29.283012 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:29.283622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:29.290554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:29.291010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:29.291774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:29.292212 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:29.427509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:29.435861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-30bceb3b-d18a-455f-af4e-7281f61623f5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.156678 Jun 20 06:24:29.436442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 955/1300] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:29 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:30.461307 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:30.462022 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:30.469682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:30.470297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:30.471417 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:30.471909 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:30.476398 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:30.610219 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:30.617982 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1d2d0305-92c3-49ac-bf73-24e15e301b32 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.166506 Jun 20 06:24:30.618552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 956/1301] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:30 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:31.635788 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:31.636561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:31.643250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:31.643786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:31.645114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:31.645731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:31.914652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:31.922106 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a65a660f-8cc1-450d-89ab-836a7fb29e15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.291105 Jun 20 06:24:31.922687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 957/1302] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:31 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:32.938115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:32.938941 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:32.948466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:32.948940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:32.949714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:32.950157 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:33.087051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:33.095044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-474ad916-0442-4cb3-8df4-ea345bf8e48d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.160744 Jun 20 06:24:33.095796 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 958/1303] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:32 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:34.111926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:34.112672 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:34.119566 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:34.120034 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:34.120830 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:34.121275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:34.248530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:34.256964 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-caa162ca-f21a-4eef-ae7a-9072a627eba5 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.148503 Jun 20 06:24:34.257795 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 959/1304] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:34 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:35.274445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:35.275128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:35.281666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:35.282124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:35.282898 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:35.283344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:35.416228 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:35.424060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9d231716-7229-4aae-a066-825d6f105f44 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.153657 Jun 20 06:24:35.424635 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 960/1305] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:35 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:36.441453 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:36.442148 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:36.449541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:36.449997 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:36.450774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:36.451666 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:36.586246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:36.595980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3b5bcc17-2cbb-4264-853c-82216347bb15 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.158331 Jun 20 06:24:36.596824 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 961/1306] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:36 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:37.612279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:37.613288 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:37.620530 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.621141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.621984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.622493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.770038 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:37.778295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1cc9c48a-12c2-4010-920c-ba5e39098b5d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.169721 Jun 20 06:24:37.787726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 962/1307] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:37 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:37.787726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:37.787726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:37.791246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.791779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.792541 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:37.793008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:37.927914 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:37.936386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a339acb8-931b-4bff-adf1-868b35a8c39f tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1594 microversion: 2.1 time: 0.156568 Jun 20 06:24:37.936978 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 963/1308] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:37 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1594 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:38.794764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:38.795550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:38.801975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:38.802657 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:38.803531 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:38.803974 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:38.967505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:38.977028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b66a17f-b93e-4815-926f-25a05d6cb3c9 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1509 microversion: 2.1 time: 0.185922 Jun 20 06:24:38.977722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 964/1309] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:38 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1509 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:38.995485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:38.996160 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:39.005139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.006312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.007517 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.007968 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.091292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-375c2c99-43ee-428d-b7c9-eaf60d56d2cf tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "POST /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125/action" status: 202 len: 0 microversion: 2.1 time: 0.099815 Jun 20 06:24:39.092096 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 965/1310] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:24:38 2022] POST /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:24:39.100826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:39.101451 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:39.108168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.108632 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.109444 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:39.109893 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:39.272073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:39.281385 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ad4ed42a-76e7-4227-bd62-e9fbce670021 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1517 microversion: 2.1 time: 0.184429 Jun 20 06:24:39.293045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 966/1311] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:39 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1517 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:40.102514 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-b85413c1-239a-41fb-9a79-54ec3b5d6248 req-d34ed4b3-ed18-486e-b4d5-a5dbfba34c42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:40.111826 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b85413c1-239a-41fb-9a79-54ec3b5d6248 req-d34ed4b3-ed18-486e-b4d5-a5dbfba34c42 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.112734 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-b85413c1-239a-41fb-9a79-54ec3b5d6248 req-d34ed4b3-ed18-486e-b4d5-a5dbfba34c42 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.125338 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-b85413c1-239a-41fb-9a79-54ec3b5d6248 req-d34ed4b3-ed18-486e-b4d5-a5dbfba34c42 service nova] Creating event network-changed:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:24:40.132051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-b85413c1-239a-41fb-9a79-54ec3b5d6248 req-d34ed4b3-ed18-486e-b4d5-a5dbfba34c42 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109847 Jun 20 06:24:40.133302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 967/1312] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:24:40.228691 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:24:40.229381 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:24:40.301305 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:40.303332 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:40.310707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.311478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.312442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.313962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.633722 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:40.645737 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cb57c757-35a6-4e4a-a88b-800254851708 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1517 microversion: 2.1 time: 0.348894 Jun 20 06:24:40.660992 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 968/1313] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:40 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1517 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:40.922768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-11d7d99a-29bf-4e10-8293-93b99b1e09c0 req-9f7c251c-72ba-41df-87aa-d5b0227a0c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "name": "network-vif-unplugged", "status": "completed", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:40.934354 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-11d7d99a-29bf-4e10-8293-93b99b1e09c0 req-9f7c251c-72ba-41df-87aa-d5b0227a0c00 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:40.935194 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-11d7d99a-29bf-4e10-8293-93b99b1e09c0 req-9f7c251c-72ba-41df-87aa-d5b0227a0c00 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:40.949731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.compute.server_external_events [req-11d7d99a-29bf-4e10-8293-93b99b1e09c0 req-9f7c251c-72ba-41df-87aa-d5b0227a0c00 service nova] Unable to find a host for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125. Dropping event network-vif-unplugged {{(pid=117585) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 20 06:24:40.956960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-11d7d99a-29bf-4e10-8293-93b99b1e09c0 req-9f7c251c-72ba-41df-87aa-d5b0227a0c00 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.037379 Jun 20 06:24:40.968457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 969/1314] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 54 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 20 06:24:41.669819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:41.671219 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:41.680220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.680821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:41.682113 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.682622 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:41.965986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:41.977449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c5dfbb7a-b282-4cb0-86b2-909357aae9d8 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1517 microversion: 2.1 time: 0.312453 Jun 20 06:24:41.978744 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 970/1315] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:41 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1517 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:41.984912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1920011686"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:41.985858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:41.994665 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.995328 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:41.996348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:41.996920 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:42.238962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.network.security_group_api [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Adding security group 2c80a419-96b4-4e5e-a29f-1f016759d3a8 to port 93c6b252-6863-4cc0-a7cb-0992845da5af Jun 20 06:24:42.727395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2ffeb78b-5d66-428c-85cf-eaa8b9887b4a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.747169 Jun 20 06:24:42.729279 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 971/1316] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:24:41 2022] POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action => generated 0 bytes in 750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:24:42.742762 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:42.743505 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:42.749926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:42.750386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:42.756413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:42.758946 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:42.981144 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:42.994583 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a554a243-8049-4af0-bfe2-c2b30e7204a5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1760 microversion: 2.1 time: 0.256889 Jun 20 06:24:42.995168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 972/1317] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:42 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1760 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:43.008344 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-ffcbce8d-a13d-4035-acc0-e8d22843c800 req-7721e037-258c-4702-b234-82143ac7e9c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:43.017149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ffcbce8d-a13d-4035-acc0-e8d22843c800 req-7721e037-258c-4702-b234-82143ac7e9c9 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:43.017597 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-ffcbce8d-a13d-4035-acc0-e8d22843c800 req-7721e037-258c-4702-b234-82143ac7e9c9 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:43.031126 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-ffcbce8d-a13d-4035-acc0-e8d22843c800 req-7721e037-258c-4702-b234-82143ac7e9c9 service nova] Creating event network-changed:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:24:43.038108 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-ffcbce8d-a13d-4035-acc0-e8d22843c800 req-7721e037-258c-4702-b234-82143ac7e9c9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035223 Jun 20 06:24:43.038764 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 973/1318] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:43.054761 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:43.055840 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:43.063164 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:43.063981 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:43.064971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:43.065410 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:43.071470 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:43.381493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:43.389525 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-66bf04f0-1368-4df2-8ae8-5f551630e13c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1519 microversion: 2.1 time: 0.349351 Jun 20 06:24:43.390101 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 974/1319] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:43 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1519 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:24:44.406395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:44.407094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:44.414226 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:44.414686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:44.415474 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:44.415921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:44.560010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:44.567460 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-2fd6e06c-7cd9-4679-a113-28032d8e4dad tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.165010 Jun 20 06:24:44.568973 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 975/1320] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:44 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:45.585934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:45.586687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:45.588889 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=78 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:24:45.595188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:45.595642 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:45.596421 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:45.596882 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:45.732135 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:45.739725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ae3f079c-399a-4a23-b1d2-c97160eeca66 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.158314 Jun 20 06:24:45.740300 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 976/1321] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:45 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:46.757669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:46.758355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:46.764865 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:46.765326 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:46.766102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:46.766550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:46.894070 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:46.902386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c8763787-990b-4b86-95b6-8f79cbfaca76 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.148960 Jun 20 06:24:46.902972 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 977/1322] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:46 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:47.924671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:47.925392 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:47.933365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:47.933819 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:47.934701 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:47.935139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:48.083911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:48.093380 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5e760340-4340-4f88-a138-5f9b0cafdd7b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.174017 Jun 20 06:24:48.093967 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 978/1323] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:47 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:49.111190 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:49.111821 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:49.119051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:49.119501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:49.120259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:49.120688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:49.251724 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:49.259926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-f94848fc-6324-43bc-8a5c-8e9ae33c627c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.152634 Jun 20 06:24:49.260507 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 979/1324] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:49 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:50.277501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:50.279552 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:50.287069 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:50.287518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:50.288312 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:50.288768 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:50.426223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:50.434731 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-97feab5e-6fb4-409c-b4bb-d6f151c47602 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.161837 Jun 20 06:24:50.435309 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 980/1325] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:50 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:51.451337 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:51.452010 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:51.458759 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:51.459216 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:51.460023 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:51.461346 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:51.592386 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:51.600020 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e4ba3a2a-88ce-4fed-b611-bd2f105e116c tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.152564 Jun 20 06:24:51.600588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 981/1326] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:51 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:52.618512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:52.619162 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:52.625654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:52.626109 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:52.626870 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:52.627315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:52.759327 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:52.766773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bf1a2512-8fa7-44da-b7fe-48e288a15e8e tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.153067 Jun 20 06:24:52.767331 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 982/1327] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:52 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:53.783413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:53.784042 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:53.790756 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:53.791217 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:53.791988 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:53.792436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:53.920963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:53.928363 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-11248bdf-c450-4eda-b25e-44768376e605 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.148841 Jun 20 06:24:53.928965 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 983/1328] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:53 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:54.945807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:54.946476 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:54.953000 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:54.953463 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:54.954247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:54.954687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:55.090073 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:55.097880 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-35c101b7-7931-4601-a0a5-1b04e1f47f68 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.156454 Jun 20 06:24:55.098458 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 984/1329] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:54 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:55.103818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-2f960ff8-e6a9-4c13-8623-1415d9a046ff req-869a79ce-7e4d-4392-a8b7-a5f0dc757390 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "name": "network-vif-plugged", "status": "completed", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:24:55.111671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2f960ff8-e6a9-4c13-8623-1415d9a046ff req-869a79ce-7e4d-4392-a8b7-a5f0dc757390 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:55.112118 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-2f960ff8-e6a9-4c13-8623-1415d9a046ff req-869a79ce-7e4d-4392-a8b7-a5f0dc757390 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:55.123111 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-2f960ff8-e6a9-4c13-8623-1415d9a046ff req-869a79ce-7e4d-4392-a8b7-a5f0dc757390 service nova] Creating event network-vif-plugged:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:24:55.128149 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-2f960ff8-e6a9-4c13-8623-1415d9a046ff req-869a79ce-7e4d-4392-a8b7-a5f0dc757390 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028471 Jun 20 06:24:55.128659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 985/1330] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:24:56.117318 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:56.118041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:56.124182 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:56.124638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:56.125429 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:56.125872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:56.260262 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:56.267780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6ee9c407-bb71-448d-a628-f956db4509ae tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1575 microversion: 2.1 time: 0.155852 Jun 20 06:24:56.268349 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 986/1331] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:56 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:24:57.285707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:24:57.286315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:24:57.292606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:57.293097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:57.293860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:24:57.294302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:24:57.437441 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:24:57.445050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1f714bac-d4de-4d3b-a290-a67a4c0da94b tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1562 microversion: 2.1 time: 0.163230 Jun 20 06:24:57.445614 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 987/1332] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:24:57 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1562 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:02.786059 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:25:02.786644 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:25:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:25:08.692166 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:08.692690 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:08.695365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=23 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:08.696074 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=78 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:08.702071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.702524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.703291 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.703728 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.729097 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:25:08.804207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-0cc80a5c-b631-4f29-8fad-5592874f61d0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 204 len: 0 microversion: 2.1 time: 0.115845 Jun 20 06:25:08.805114 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 988/1333] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:25:08 2022] DELETE /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:25:08.811241 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-9410bbbd-633b-424a-aebb-c288a0a8f680 req-3afd98f4-81d8-4a32-9493-99a2289c059d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9050c7ed-c955-4eb3-baf3-c408600adf98", "tag": "0b583502-8f47-464f-a231-fd2eb96ecc1e"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:25:08.819482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-9410bbbd-633b-424a-aebb-c288a0a8f680 req-3afd98f4-81d8-4a32-9493-99a2289c059d service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.819933 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-9410bbbd-633b-424a-aebb-c288a0a8f680 req-3afd98f4-81d8-4a32-9493-99a2289c059d service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.830897 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-9410bbbd-633b-424a-aebb-c288a0a8f680 req-3afd98f4-81d8-4a32-9493-99a2289c059d service nova] Creating event network-changed:0b583502-8f47-464f-a231-fd2eb96ecc1e for instance 9050c7ed-c955-4eb3-baf3-c408600adf98 on hv-cinder-80403 Jun 20 06:25:08.835677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-9410bbbd-633b-424a-aebb-c288a0a8f680 req-3afd98f4-81d8-4a32-9493-99a2289c059d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028611 Jun 20 06:25:08.836454 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 989/1334] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:25:08.841599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:08.842302 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:08.848416 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.848959 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.849798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:08.850293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:08.985652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:08.993292 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1a66ae3d-fecc-4b77-88cd-43e0e5404488 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1579 microversion: 2.1 time: 0.155500 Jun 20 06:25:08.993878 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 990/1335] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:08 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:10.011712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:10.012461 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:10.019638 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:10.020103 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:10.021008 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:10.021457 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:10.218456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:10.226283 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-fd486bde-eb0a-40e0-83a1-9e2fc16fc8ef tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1579 microversion: 2.1 time: 0.219286 Jun 20 06:25:10.226863 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 991/1336] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:10 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1579 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:11.244407 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:11.245060 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:11.251575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:11.252045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:11.252840 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:11.253285 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:11.342587 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:11.350412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-aac49bd8-6e47-4a23-9813-1a7490f4fa4f tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 200 len: 1392 microversion: 2.1 time: 0.110761 Jun 20 06:25:11.360252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 992/1337] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:11 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 1392 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:11.413856 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-eca1aaf4-f261-410a-a5e2-3c12c133d7f4 req-a5815170-dbff-4701-afe4-9397ede52cd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9050c7ed-c955-4eb3-baf3-c408600adf98", "name": "network-vif-deleted", "tag": "0b583502-8f47-464f-a231-fd2eb96ecc1e"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:25:11.423654 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-eca1aaf4-f261-410a-a5e2-3c12c133d7f4 req-a5815170-dbff-4701-afe4-9397ede52cd4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:11.424116 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-eca1aaf4-f261-410a-a5e2-3c12c133d7f4 req-a5815170-dbff-4701-afe4-9397ede52cd4 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:11.436524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-eca1aaf4-f261-410a-a5e2-3c12c133d7f4 req-a5815170-dbff-4701-afe4-9397ede52cd4 service nova] Creating event network-vif-deleted:0b583502-8f47-464f-a231-fd2eb96ecc1e for instance 9050c7ed-c955-4eb3-baf3-c408600adf98 on hv-cinder-80403 Jun 20 06:25:11.442028 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-eca1aaf4-f261-410a-a5e2-3c12c133d7f4 req-a5815170-dbff-4701-afe4-9397ede52cd4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031504 Jun 20 06:25:11.442975 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 993/1338] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:25:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:25:12.368732 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:12.369424 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 9050c7ed-c955-4eb3-baf3-c408600adf98] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:12.378524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:12.379242 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:12.380227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:12.380917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:12.396494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] HTTP exception thrown: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Request method failure captured: Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 HTTP/1.1 Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBORLUSBuUnh4-Y_RiMgSbHClzypRYakUqoBLPjpQfELm8M_auCU4PdlUi_7HZmMJdfDY2vO744NforUGcNzCO7KjfigzHQpDuQjyWOuMhpX0wCnAYUph1M49oU8Qbt8fceRKOuzXBFWglmBp1WMWzPWVMtCOhwgkI5WkYNuGtQ32s Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:25:12.398188 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}] Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b19967e2b09342e9ac006151002bf71a Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. Jun 20 06:25:12.401218 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '9050c7ed-c955-4eb3-baf3-c408600adf98'} Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:25:12.402298 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. Jun 20 06:25:12.404047 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:12.405611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Returning 404 to user: Instance 9050c7ed-c955-4eb3-baf3-c408600adf98 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:25:12.405611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-8620d806-9d55-4e1c-a2a9-d9a44fdb607b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98" status: 404 len: 111 microversion: 2.1 time: 0.036748 Jun 20 06:25:12.405611 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 994/1339] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:12 2022] GET /compute/v2.1/servers/9050c7ed-c955-4eb3-baf3-c408600adf98 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:25:15.477025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:15.477598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:15.484497 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.484986 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.485763 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.486205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.513509 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:25:15.591760 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-70a1569d-4c36-49b6-a948-07a4e6b30e5c tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 204 len: 0 microversion: 2.1 time: 0.118335 Jun 20 06:25:15.592379 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 995/1340] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:25:15 2022] DELETE /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 20 06:25:15.597922 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-be41ff3e-c1f9-47a3-b6cf-9318c732d93d req-0924ae0c-5070-4e52-af4f-0e715b2efaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cd0bd75-da64-4cf4-ae19-4e2e961a4860", "tag": "4c0e5135-e66c-4043-85ae-c343bfa67dd9"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:25:15.606678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-be41ff3e-c1f9-47a3-b6cf-9318c732d93d req-0924ae0c-5070-4e52-af4f-0e715b2efaf7 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.607120 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-be41ff3e-c1f9-47a3-b6cf-9318c732d93d req-0924ae0c-5070-4e52-af4f-0e715b2efaf7 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.618248 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-be41ff3e-c1f9-47a3-b6cf-9318c732d93d req-0924ae0c-5070-4e52-af4f-0e715b2efaf7 service nova] Creating event network-changed:4c0e5135-e66c-4043-85ae-c343bfa67dd9 for instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 on hv-cinder-80403 Jun 20 06:25:15.623102 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-be41ff3e-c1f9-47a3-b6cf-9318c732d93d req-0924ae0c-5070-4e52-af4f-0e715b2efaf7 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029336 Jun 20 06:25:15.623860 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 996/1341] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:25:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:25:15.628623 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:15.629364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:15.636024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.636484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.637297 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:15.637740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:15.770669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:15.778512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1b585d9c-7e7a-4fcc-8d93-171ffa232aae tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1576 microversion: 2.1 time: 0.153720 Jun 20 06:25:15.779081 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 997/1342] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:15 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:16.797004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:16.798364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:16.805191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:16.805746 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:16.806652 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:16.807330 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:17.033124 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b19967e2b09342e9ac006151002bf71a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bcde2f2809247979837902b91d6a6cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:17.040970 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-a5828829-9837-41b6-8856-30f7a80e038b tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 200 len: 1458 microversion: 2.1 time: 0.248754 Jun 20 06:25:17.041620 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 998/1343] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:16 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 1458 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:17.192608 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-d17283d6-6ad5-4dd5-8868-42943125ee04 req-6d66a8f2-87e0-4598-a543-e14fe780eb4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cd0bd75-da64-4cf4-ae19-4e2e961a4860", "name": "network-vif-deleted", "tag": "4c0e5135-e66c-4043-85ae-c343bfa67dd9"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:25:17.201094 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-d17283d6-6ad5-4dd5-8868-42943125ee04 req-6d66a8f2-87e0-4598-a543-e14fe780eb4c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:17.201540 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-d17283d6-6ad5-4dd5-8868-42943125ee04 req-6d66a8f2-87e0-4598-a543-e14fe780eb4c service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:17.213543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-d17283d6-6ad5-4dd5-8868-42943125ee04 req-6d66a8f2-87e0-4598-a543-e14fe780eb4c service nova] Creating event network-vif-deleted:4c0e5135-e66c-4043-85ae-c343bfa67dd9 for instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 on hv-cinder-80403 Jun 20 06:25:17.218246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-d17283d6-6ad5-4dd5-8868-42943125ee04 req-6d66a8f2-87e0-4598-a543-e14fe780eb4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029289 Jun 20 06:25:17.219129 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 999/1344] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:25:18.060050 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:18.060780 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 3cd0bd75-da64-4cf4-ae19-4e2e961a4860] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:18.066895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.067348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.068115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.068554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.083026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] HTTP exception thrown: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Request method failure captured: Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 HTTP/1.1 Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBORLUSBuUnh4-Y_RiMgSbHClzypRYakUqoBLPjpQfELm8M_auCU4PdlUi_7HZmMJdfDY2vO744NforUGcNzCO7KjfigzHQpDuQjyWOuMhpX0wCnAYUph1M49oU8Qbt8fceRKOuzXBFWglmBp1WMWzPWVMtCOhwgkI5WkYNuGtQ32s Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:25:18.084773 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}] Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b19967e2b09342e9ac006151002bf71a Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. Jun 20 06:25:18.087836 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '3cd0bd75-da64-4cf4-ae19-4e2e961a4860'} Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:25:18.088876 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. Jun 20 06:25:18.091252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.093659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Returning 404 to user: Instance 3cd0bd75-da64-4cf4-ae19-4e2e961a4860 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:25:18.093659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d0b6d560-d568-47ff-9f21-98f0c78cd7b0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860" status: 404 len: 111 microversion: 2.1 time: 0.030828 Jun 20 06:25:18.093659 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1000/1345] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:18 2022] GET /compute/v2.1/servers/3cd0bd75-da64-4cf4-ae19-4e2e961a4860 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:25:18.518738 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:18.519234 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:18.526116 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.526571 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.527342 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.527783 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.541524 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] HTTP exception thrown: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Request method failure captured: Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a HTTP/1.1 Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBORLUSBuUnh4-Y_RiMgSbHClzypRYakUqoBLPjpQfELm8M_auCU4PdlUi_7HZmMJdfDY2vO744NforUGcNzCO7KjfigzHQpDuQjyWOuMhpX0wCnAYUph1M49oU8Qbt8fceRKOuzXBFWglmBp1WMWzPWVMtCOhwgkI5WkYNuGtQ32s Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:25:18.543059 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}] Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b19967e2b09342e9ac006151002bf71a Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.544861 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '6135799a-c691-4c98-af12-4cce0ab2da1a'} Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:25:18.545786 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.547130 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.548528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Returning 404 to user: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:25:18.548528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-c950fa41-39f2-48dc-a60f-067bddddff68 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 404 len: 111 microversion: 2.1 time: 0.029565 Jun 20 06:25:18.548528 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1001/1346] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:25:18 2022] DELETE /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:25:18.552712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:18.553333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] [instance: 6135799a-c691-4c98-af12-4cce0ab2da1a] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:18.559337 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.559798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.560561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:18.561041 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:18.574544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] HTTP exception thrown: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Request method failure captured: Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a HTTP/1.1 Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBBORLUSBuUnh4-Y_RiMgSbHClzypRYakUqoBLPjpQfELm8M_auCU4PdlUi_7HZmMJdfDY2vO744NforUGcNzCO7KjfigzHQpDuQjyWOuMhpX0wCnAYUph1M49oU8Qbt8fceRKOuzXBFWglmBp1WMWzPWVMtCOhwgkI5WkYNuGtQ32s Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:25:18.576044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7bcde2f2809247979837902b91d6a6cb"}]}] Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 7bcde2f2809247979837902b91d6a6cb Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestVolumeBootPattern-545913659 Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: b19967e2b09342e9ac006151002bf71a Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestVolumeBootPattern-545913659-project Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.577812 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '6135799a-c691-4c98-af12-4cce0ab2da1a'} Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:25:18.578917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. Jun 20 06:25:18.580506 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:25:18.582139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Returning 404 to user: Instance 6135799a-c691-4c98-af12-4cce0ab2da1a could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:25:18.582139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3b724fa3-d7da-4c1a-9caf-4855a4540ee0 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a" status: 404 len: 111 microversion: 2.1 time: 0.028191 Jun 20 06:25:18.582139 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1002/1347] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:18 2022] GET /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:25:19.865233 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-1df8aa8b-816d-45c8-88f3-05ccee44ffd3 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] Calling method '.version_select at 0x7f21ed06be50>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:19.887582 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-1df8aa8b-816d-45c8-88f3-05ccee44ffd3 tempest-TestVolumeBootPattern-545913659 tempest-TestVolumeBootPattern-545913659-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1814282609" status: 202 len: 0 microversion: 2.1 time: 0.026154 Jun 20 06:25:19.888176 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1003/1348] 10.222.0.39 () {58 vars in 1262 bytes} [Mon Jun 20 06:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1814282609 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:25:40.470229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:40.471089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:40.475295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:25:40.477572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:40.485191 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.485726 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.486493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.486936 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.562089 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-67e0197c-9630-4e94-8ae7-f533ebfd4ea5 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.093289 Jun 20 06:25:40.562707 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1004/1349] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:25:40 2022] POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:25:40.572798 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:40.573637 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:40.580343 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.580740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.581660 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:40.582132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:40.825688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:40.833676 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7dc82bf7-f2b8-44d4-af73-1e3959bd8c68 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1752 microversion: 2.1 time: 0.266551 Jun 20 06:25:40.834247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1005/1350] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:40 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:41.852549 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:41.853249 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:41.859984 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:41.860445 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:41.861263 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:41.861712 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:42.005033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:42.013590 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cc231652-3bbd-4fd5-960a-e1dd195b9abe tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.164983 Jun 20 06:25:42.014167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1006/1351] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:41 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:43.030989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:43.031680 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:43.038150 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:43.038725 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:43.039518 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:43.039952 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:43.182227 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:43.190397 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-993cc0c6-dc2f-4df5-b7c6-2ffc6fe34986 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.163211 Jun 20 06:25:43.198401 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1007/1352] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:43 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:44.207367 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:44.208051 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:44.215044 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:44.215501 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:44.216261 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:44.216774 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:44.356494 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:44.364333 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6d003bbd-6605-4f01-af98-a3a23849df91 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.160861 Jun 20 06:25:44.364928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1008/1353] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:44 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:45.381634 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:45.382599 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:45.396520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:45.397011 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:45.398272 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:45.398706 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:45.550681 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:45.558668 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ff041fc8-842f-4658-b8de-4942464560fd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.181029 Jun 20 06:25:45.559232 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1009/1354] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:45 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:25:46.575586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:46.576355 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:46.583468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:46.583930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:46.584911 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:46.585390 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:46.731883 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:46.739727 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-38344703-6185-40ae-80fb-3b1a8ef7a365 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.168025 Jun 20 06:25:46.740289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1010/1355] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:46 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:47.760434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:47.761245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:47.767692 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:47.768146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:47.768934 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:47.769371 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:47.912837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:47.921175 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4d70bf11-7ff2-49a1-8008-7c497964949a tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.165309 Jun 20 06:25:47.921742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1011/1356] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:47 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:48.938277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:48.938917 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:48.945510 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:48.945906 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:48.946670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:48.947115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:49.085687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:49.093671 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-19de5811-8d86-4803-8d0b-6cd7d3b51065 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.159312 Jun 20 06:25:49.094244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1012/1357] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:48 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:50.111229 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:50.111916 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:50.118296 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:50.118754 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:50.119512 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:50.119947 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:50.263584 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:50.271485 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-50382de8-741d-47ec-b0f0-892b8939845c tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.164111 Jun 20 06:25:50.272056 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1013/1358] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:50 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:51.289527 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:51.290147 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:51.296682 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:51.297159 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:51.297913 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:51.298348 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:51.438740 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:51.447040 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6ef21af7-768b-4563-80b5-20bf3cd8f9cd tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.161847 Jun 20 06:25:51.447628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1014/1359] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:51 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:52.465250 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:52.466289 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:52.473168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:52.473628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:52.474658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:52.475434 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:52.618940 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:52.626714 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bd44450a-9d11-4977-8939-86d7b1bcaab0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.167301 Jun 20 06:25:52.627277 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1015/1360] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:52 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:53.643598 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:53.644247 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:53.651132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:53.651591 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:53.652364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:53.652859 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:53.798245 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:53.806989 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-3c4a83e3-713e-4c3a-8af6-b2cd2e96e424 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.167455 Jun 20 06:25:53.807557 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1016/1361] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:53 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:54.823966 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:54.824678 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:54.830987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:54.831442 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:54.832205 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:54.832644 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:54.970493 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:54.978484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-bd20b452-3bed-4487-ab21-60bb3dfe1f32 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.159040 Jun 20 06:25:54.979052 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1017/1362] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:54 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:55.996128 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:55.996866 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:56.003266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:56.003718 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:56.004475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:56.004942 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:56.152962 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:56.160956 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-80ed7981-b2b6-498b-9652-a24d5b788e23 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1757 microversion: 2.1 time: 0.168677 Jun 20 06:25:56.161556 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1018/1363] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:55 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:25:57.179478 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:25:57.180184 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:25:57.186364 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:57.186818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:57.187586 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:25:57.188026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:25:57.205837 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:25:57.329818 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:25:57.338499 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-adb5442b-12be-43c5-aaa5-a2f0abe42452 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1760 microversion: 2.1 time: 0.163581 Jun 20 06:25:57.339065 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1019/1364] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:25:57 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1760 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:19.228099 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:26:19.228859 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:26:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:26:34.736240 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:34.736828 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:34.738971 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=32 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:34.739742 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=2 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:26:34.746246 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.746698 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.747467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.747901 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.772949 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:26:34.848438 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-cd4fad31-019e-4b89-9ef4-4c4971581913 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "DELETE /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 204 len: 0 microversion: 2.1 time: 0.115604 Jun 20 06:26:34.849171 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1020/1365] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:26:34 2022] DELETE /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:26:34.855779 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-05a43ae9-5021-407f-973d-28fc40685c7a req-271c9092-8324-4a82-bf16-d003def5d1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:26:34.865498 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-05a43ae9-5021-407f-973d-28fc40685c7a req-271c9092-8324-4a82-bf16-d003def5d1d0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.865955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-05a43ae9-5021-407f-973d-28fc40685c7a req-271c9092-8324-4a82-bf16-d003def5d1d0 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.877025 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-05a43ae9-5021-407f-973d-28fc40685c7a req-271c9092-8324-4a82-bf16-d003def5d1d0 service nova] Creating event network-changed:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:26:34.881832 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-05a43ae9-5021-407f-973d-28fc40685c7a req-271c9092-8324-4a82-bf16-d003def5d1d0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031372 Jun 20 06:26:34.882423 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1021/1366] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:26:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:26:34.887550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:34.888252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:34.894462 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.894927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:34.895704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:34.896146 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:35.182872 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:35.190384 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-98e16b23-0c59-490f-b4e9-199bfd4a16fd tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.306774 Jun 20 06:26:35.191068 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1022/1367] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:34 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:26:36.207990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:36.208606 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:36.215686 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:36.216195 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:36.217045 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:36.217482 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:36.349413 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:36.357168 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-91cb5929-a308-4385-9753-3b2e69f9bb9d tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1568 microversion: 2.1 time: 0.152998 Jun 20 06:26:36.357735 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1023/1368] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:36 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:37.374275 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:37.374961 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:37.381802 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:37.382252 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:37.383197 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:37.383456 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:37.613220 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8ff165426d14c09a7221a910ca7febc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c7d8d09f3b94090bbb08abbc1842a42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:26:37.620790 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-98e5364d-391b-420d-be77-acb85ad4a76a tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 200 len: 1450 microversion: 2.1 time: 0.250361 Jun 20 06:26:37.621365 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1024/1369] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:37 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 1450 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:26:37.642677 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-39987038-39fb-4f17-81da-01402fbb1b54 req-720a0fa0-8ef1-4e88-b62f-0763e0202651 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "692ea93e-f0ec-4dd5-a7af-4e192f859125", "name": "network-vif-deleted", "tag": "23d58c46-937b-4a93-b868-7f130a3a1285"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:26:37.651850 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-39987038-39fb-4f17-81da-01402fbb1b54 req-720a0fa0-8ef1-4e88-b62f-0763e0202651 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:37.652294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-39987038-39fb-4f17-81da-01402fbb1b54 req-720a0fa0-8ef1-4e88-b62f-0763e0202651 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:37.664223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-39987038-39fb-4f17-81da-01402fbb1b54 req-720a0fa0-8ef1-4e88-b62f-0763e0202651 service nova] Creating event network-vif-deleted:23d58c46-937b-4a93-b868-7f130a3a1285 for instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 on hv-cinder-80403 Jun 20 06:26:37.669683 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-39987038-39fb-4f17-81da-01402fbb1b54 req-720a0fa0-8ef1-4e88-b62f-0763e0202651 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030668 Jun 20 06:26:37.670729 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1025/1370] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 20 06:26:38.638315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:38.639017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] [instance: 692ea93e-f0ec-4dd5-a7af-4e192f859125] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:26:38.645259 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:38.645721 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:38.646492 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:26:38.646937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:26:38.662877 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] HTTP exception thrown: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Request method failure captured: Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 HTTP/1.1 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBGhztGW72VgkaKV3BV2jsGzVn83MvKjlJ3CKYT42dhuiOTb-XuM-uNI4GPlzDRiJ-znTBXUfBR1oR28ar_8v2tOvJb7f6xn_BmFiIUf0Qt3ilsrZXFaYHuAQnq0oItlYoDgKNM9VGKLON1v7kdU7DTxAisRVmDykroJ-valac_jmP8 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 4c7d8d09f3b94090bbb08abbc1842a42 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestShelveInstance-111203781 Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:26:38.664833 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4c7d8d09f3b94090bbb08abbc1842a42"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4c7d8d09f3b94090bbb08abbc1842a42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c7d8d09f3b94090bbb08abbc1842a42"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4c7d8d09f3b94090bbb08abbc1842a42"}]}] Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestShelveInstance-111203781 Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 4c7d8d09f3b94090bbb08abbc1842a42 Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestShelveInstance-111203781 Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestShelveInstance-111203781-project Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: d8ff165426d14c09a7221a910ca7febc Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestShelveInstance-111203781-project Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. Jun 20 06:26:38.667287 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '692ea93e-f0ec-4dd5-a7af-4e192f859125'} Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:26:38.668574 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. Jun 20 06:26:38.670436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:26:38.672004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Returning 404 to user: Instance 692ea93e-f0ec-4dd5-a7af-4e192f859125 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:26:38.672004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-e1d35ea6-1049-4efb-a51a-844d16427e45 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125" status: 404 len: 111 microversion: 2.1 time: 0.033386 Jun 20 06:26:38.672004 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1026/1371] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:26:38 2022] GET /compute/v2.1/servers/692ea93e-f0ec-4dd5-a7af-4e192f859125 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 20 06:26:38.828173 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-9a1d41e6-4614-48b5-aa9d-4e883313d3b7 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] Calling method '.version_select at 0x7f21f030a670>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:26:38.848854 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-9a1d41e6-4614-48b5-aa9d-4e883313d3b7 tempest-TestShelveInstance-111203781 tempest-TestShelveInstance-111203781-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-535861818" status: 202 len: 0 microversion: 2.1 time: 0.024025 Jun 20 06:26:38.849104 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1027/1372] 10.222.0.39 () {58 vars in 1250 bytes} [Mon Jun 20 06:26:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-535861818 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:27:00.584057 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:00.584926 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG dbcounter [-] [117585] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117585) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 20 06:27:00.589484 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1920011686"}} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:27:00.590017 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:00.597910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.598366 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.599132 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:00.599575 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:00.727588 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.network.security_group_api [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Removing security group 2c80a419-96b4-4e5e-a29f-1f016759d3a8 from port 93c6b252-6863-4cc0-a7cb-0992845da5af Jun 20 06:27:01.070794 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6840f9bc-9d43-49f9-b38b-31aa528d77d6 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action" status: 202 len: 0 microversion: 2.1 time: 0.488272 Jun 20 06:27:01.075122 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1028/1373] 10.222.0.39 () {60 vars in 1277 bytes} [Mon Jun 20 06:27:00 2022] POST /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/action => generated 0 bytes in 490 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:27:01.086293 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-56183d44-c21b-4295-8e5e-5edaad064409 req-b7d8f5c0-3fd8-4def-8be6-10a142447d58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:27:01.103858 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-56183d44-c21b-4295-8e5e-5edaad064409 req-b7d8f5c0-3fd8-4def-8be6-10a142447d58 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:01.104831 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-56183d44-c21b-4295-8e5e-5edaad064409 req-b7d8f5c0-3fd8-4def-8be6-10a142447d58 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:01.116604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-56183d44-c21b-4295-8e5e-5edaad064409 req-b7d8f5c0-3fd8-4def-8be6-10a142447d58 service nova] Creating event network-changed:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:27:01.126932 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-56183d44-c21b-4295-8e5e-5edaad064409 req-b7d8f5c0-3fd8-4def-8be6-10a142447d58 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044266 Jun 20 06:27:01.127912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1029/1374] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:27:02.154533 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:02.155141 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:02.161255 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.161711 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.162470 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.162907 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.253635 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.objects.instance [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lazy-loading 'services' on Instance uuid 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 {{(pid=117585) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 20 06:27:02.334670 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-637ec359-ebf8-4990-a301-07cbce44b411 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments/bf1a3007-8967-405d-82d6-2716b89ecb0b" status: 202 len: 0 microversion: 2.1 time: 0.185520 Jun 20 06:27:02.335875 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1030/1375] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:27:02 2022] DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments/bf1a3007-8967-405d-82d6-2716b89ecb0b => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 20 06:27:02.342374 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-6aa0b99d-7b34-4f72-9b94-97d2bdca4cab req-a220343c-244b-428a-bbaa-d656ed968843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:27:02.351544 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6aa0b99d-7b34-4f72-9b94-97d2bdca4cab req-a220343c-244b-428a-bbaa-d656ed968843 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.351955 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-6aa0b99d-7b34-4f72-9b94-97d2bdca4cab req-a220343c-244b-428a-bbaa-d656ed968843 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.365145 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-6aa0b99d-7b34-4f72-9b94-97d2bdca4cab req-a220343c-244b-428a-bbaa-d656ed968843 service nova] Creating event network-changed:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:27:02.370110 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-6aa0b99d-7b34-4f72-9b94-97d2bdca4cab req-a220343c-244b-428a-bbaa-d656ed968843 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032963 Jun 20 06:27:02.371026 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1031/1376] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:27:02.376264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:02.377319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:02.390466 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.391282 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.392658 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:02.393550 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:02.437264 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d9989ab3-0c50-4150-b9e6-9b7ccdf01167 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064988 Jun 20 06:27:02.437838 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1032/1377] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:27:02 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:27:03.449449 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:03.450387 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:03.457075 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.457468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.458244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.458687 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.486679 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-d81c4163-740b-4ce3-8e93-0028800292ae tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041879 Jun 20 06:27:03.487238 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1033/1378] 10.222.0.39 () {58 vars in 1301 bytes} [Mon Jun 20 06:27:03 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 20 06:27:03.497181 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:03.497684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:03.503244 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.503704 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.504467 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:03.504937 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:03.584377 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] HTTP exception thrown: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 is not attached to volume bf1a3007-8967-405d-82d6-2716b89ecb0b Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Request method failure captured: Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments/bf1a3007-8967-405d-82d6-2716b89ecb0b HTTP/1.1 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBJgUvH9Ls-1I_VgY9CMvCMf8stNnwoF2bamAIjbg48jFQu7k5VquhoGWTZ1Ia2Gn1i0RtvZUCgvPqOBjwZ38zI1HWPrZbZqGTGcDWAnHORDKbZzwKBbSm5snV611-6EbBQHDnw3iaXZLRLttiO12yA-44xLBkNNr50-P53CcdCqCkI Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 205a62429cea49ba80167ac7866639f0 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:27:03.590061 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_205a62429cea49ba80167ac7866639f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/205a62429cea49ba80167ac7866639f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/205a62429cea49ba80167ac7866639f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/205a62429cea49ba80167ac7866639f0"}]}] Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 205a62429cea49ba80167ac7866639f0 Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestMinimumBasicScenario-604051380-project Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: c7e9f3f1a65e4204887ee69de7cf2f58 Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestMinimumBasicScenario-604051380-project Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:27:03.591817 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 is not attached to volume bf1a3007-8967-405d-82d6-2716b89ecb0b Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'server_id': '2702a25b-1e98-4d6e-a48c-8fafcb744ac3', 'id': 'bf1a3007-8967-405d-82d6-2716b89ecb0b'} Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id bf1a3007-8967-405d-82d6-2716b89ecb0b. Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:27:03.593024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 is not attached to volume bf1a3007-8967-405d-82d6-2716b89ecb0b Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 is not attached to volume bf1a3007-8967-405d-82d6-2716b89ecb0b Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:03.594616 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Returning 404 to user: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 is not attached to volume bf1a3007-8967-405d-82d6-2716b89ecb0b {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:27:03.595960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-6b87d765-5a27-4bad-8ca0-201e5db08f96 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments/bf1a3007-8967-405d-82d6-2716b89ecb0b" status: 404 len: 154 microversion: 2.1 time: 0.098634 Jun 20 06:27:03.595960 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1034/1379] 10.222.0.39 () {58 vars in 1415 bytes} [Mon Jun 20 06:27:03 2022] DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3/os-volume_attachments/bf1a3007-8967-405d-82d6-2716b89ecb0b => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:27:04.727376 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:04.727927 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:04.737560 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.738412 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:04.739628 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.740121 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:04.766805 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Going to try to terminate instance {{(pid=117585) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 20 06:27:04.839290 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-11af36ee-3169-4c7a-9474-5414098b5176 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 204 len: 0 microversion: 2.1 time: 0.115570 Jun 20 06:27:04.839963 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1035/1380] 10.222.0.39 () {58 vars in 1238 bytes} [Mon Jun 20 06:27:04 2022] DELETE /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 20 06:27:04.848561 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:04.849295 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:04.855468 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.855921 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:04.856688 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:04.857315 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:04.984058 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:04.991604 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-4c6e99df-faf0-4387-98aa-f6979d379a38 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1554 microversion: 2.1 time: 0.147118 Jun 20 06:27:04.992167 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1036/1381] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:04 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 20 06:27:06.009223 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:06.010402 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:06.017024 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.017475 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.018294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:06.018684 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:06.144358 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:06.152425 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-ec9457f8-6e2b-47e6-a109-2ace2d88fff8 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1554 microversion: 2.1 time: 0.147144 Jun 20 06:27:06.153029 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1037/1382] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:06 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1554 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:07.169904 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:07.170554 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:07.176928 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.177381 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.178142 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.178576 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.264082 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.policy [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7e9f3f1a65e4204887ee69de7cf2f58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '205a62429cea49ba80167ac7866639f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117585) authorize /opt/stack/nova/nova/policy.py:199}} Jun 20 06:27:07.271990 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-7c50a0cf-d4d8-42b7-bd7f-0e30e116f72e tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 200 len: 1512 microversion: 2.1 time: 0.106569 Jun 20 06:27:07.272674 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1038/1383] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:07 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 1512 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 20 06:27:07.278071 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [req-24676edb-5afc-47f1-9f85-2e0238b46d27 req-e418f72c-5aa8-4d15-98cb-a116c12d1329 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2702a25b-1e98-4d6e-a48c-8fafcb744ac3", "name": "network-vif-deleted", "tag": "93c6b252-6863-4cc0-a7cb-0992845da5af"}]} {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 20 06:27:07.286520 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-24676edb-5afc-47f1-9f85-2e0238b46d27 req-e418f72c-5aa8-4d15-98cb-a116c12d1329 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:07.286980 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [req-24676edb-5afc-47f1-9f85-2e0238b46d27 req-e418f72c-5aa8-4d15-98cb-a116c12d1329 service nova] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:07.299395 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.compute.server_external_events [req-24676edb-5afc-47f1-9f85-2e0238b46d27 req-e418f72c-5aa8-4d15-98cb-a116c12d1329 service nova] Creating event network-vif-deleted:93c6b252-6863-4cc0-a7cb-0992845da5af for instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 on hv-cinder-80403 Jun 20 06:27:07.304720 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [req-24676edb-5afc-47f1-9f85-2e0238b46d27 req-e418f72c-5aa8-4d15-98cb-a116c12d1329 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030856 Jun 20 06:27:07.305359 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1039/1384] 10.222.0.39 () {64 vars in 1317 bytes} [Mon Jun 20 06:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 20 06:27:08.290910 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:08.292179 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.compute.api [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] [instance: 2702a25b-1e98-4d6e-a48c-8fafcb744ac3] Fetching instance by UUID {{(pid=117585) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 20 06:27:08.298436 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.298895 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.299669 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 20 06:27:08.300119 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG oslo_concurrency.lockutils [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Lock "e28d6b1b-8395-40bc-a597-ebf7d975d5d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117585) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 20 06:27:08.313807 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.wsgi [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] HTTP exception thrown: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Request method failure captured: Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: request: GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 HTTP/1.1 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept: application/json Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Accept-Encoding: identity Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Connection: close Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Length: 0 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Content-Type: application/json Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Host: 10.222.0.39 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Openstack-System-Scope: None Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: User-Agent: python-urllib3/1.26.9 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Auth-Token: gAAAAABisBJgUvH9Ls-1I_VgY9CMvCMf8stNnwoF2bamAIjbg48jFQu7k5VquhoGWTZ1Ia2Gn1i0RtvZUCgvPqOBjwZ38zI1HWPrZbZqGTGcDWAnHORDKbZzwKBbSm5snV611-6EbBQHDnw3iaXZLRLttiO12yA-44xLBkNNr50-P53CcdCqCkI Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Id: None Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Domain-Name: None Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Identity-Status: Confirmed Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Is-Admin-Project: True Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Id: default Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Domain-Name: Default Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Id: 205a62429cea49ba80167ac7866639f0 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Project-Name: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Role: reader,member Jun 20 06:27:08.315393 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Roles: reader,member Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_205a62429cea49ba80167ac7866639f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/205a62429cea49ba80167ac7866639f0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/205a62429cea49ba80167ac7866639f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/205a62429cea49ba80167ac7866639f0"}]}] Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Id: 205a62429cea49ba80167ac7866639f0 Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-Tenant-Name: tempest-TestMinimumBasicScenario-604051380 Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User: tempest-TestMinimumBasicScenario-604051380-project Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Id: default Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Domain-Name: Default Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Id: c7e9f3f1a65e4204887ee69de7cf2f58 Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: X-User-Name: tempest-TestMinimumBasicScenario-604051380-project Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: method: > Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: exception: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. Jun 20 06:27:08.317207 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: action_args: {'id': '2702a25b-1e98-4d6e-a48c-8fafcb744ac3'} Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 20 06:27:08.318209 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. Jun 20 06:27:08.319912 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: ERROR nova.api.openstack.wsgi Jun 20 06:27:08.321426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Returning 404 to user: Instance 2702a25b-1e98-4d6e-a48c-8fafcb744ac3 could not be found. {{(pid=117585) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 20 06:27:08.321426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-5f86aaf7-4886-434c-8283-a479f6b49993 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3" status: 404 len: 111 microversion: 2.1 time: 0.030661 Jun 20 06:27:08.321426 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1040/1385] 10.222.0.39 () {58 vars in 1235 bytes} [Mon Jun 20 06:27:08 2022] GET /compute/v2.1/servers/2702a25b-1e98-4d6e-a48c-8fafcb744ac3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 20 06:27:08.325266 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: DEBUG nova.api.openstack.wsgi [None req-74cfa429-636b-45e2-878c-ad4e93110ef0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] Calling method '.version_select at 0x7f21ecff0ca0>' {{(pid=117585) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 20 06:27:08.341987 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO nova.api.openstack.requestlog [None req-74cfa429-636b-45e2-878c-ad4e93110ef0 tempest-TestMinimumBasicScenario-604051380 tempest-TestMinimumBasicScenario-604051380-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445107466" status: 202 len: 0 microversion: 2.1 time: 0.020278 Jun 20 06:27:08.342543 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: [pid: 117585|app: 0|req: 1041/1386] 10.222.0.39 () {58 vars in 1271 bytes} [Mon Jun 20 06:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1445107466 => generated 0 bytes in 21 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 20 06:28:00.238333 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:28:00.238974 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:28:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:28:22.794939 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:28:22.795699 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:28:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:29:39.236782 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:29:39.237663 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:29:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:29:40.798319 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:29:40.798930 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Mon Jun 20 06:29:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:29:56.434439 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:29:56.435115 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Mon Jun 20 06:29:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:30:03.411735 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:30:03.412294 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Mon Jun 20 06:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 20 06:31:20.247438 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:31:20.248079 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:31:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:31:42.803316 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:31:42.804023 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:31:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:32:59.244559 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:32:59.245308 dv-cinder-804035-47-iscsi devstack@n-api.service[117586]: Mon Jun 20 06:32:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6135799a-c691-4c98-af12-4cce0ab2da1a (ip 10.222.0.39) !!! Jun 20 06:33:00.806033 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 20 06:33:00.806572 dv-cinder-804035-47-iscsi devstack@n-api.service[117585]: Mon Jun 20 06:33:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!